The article at https://www.techspot.com/news/106874-ai-accelerates-superbug-solution-completing-two-days-what.html highlights a Google AI CoScientist project featuring a multi-agent system that generates original hypotheses without any gradient-based t…
The biggest criticism of LLMs is that they are stochastic parrots, not capable of understanding what they say. With Anthropic's research, it has become increasingly evident that this is not the case and that LLMs have real-world understanding. Howe…
Please comment on what you believe will be a necessary development to reach AGI. To start, I'll try to frame what we have now in such a way that it becomes apparent what is missing, if we were to compare AI to human intelligence, and how we might a…
I've been digging into that Google DeepMind AGI safety paper (https://arxiv.org/html/2504.01849v1). As someone trying to make sense of potential timelines from within the research trenches, their Chapter 3, outlining core development assumptions, c…
I think never has life been as uncertain as it is now. The ever increasing amount of change and foresight of AGI in coming years means that its hard to adapt. Nobody knows exactly how the world will change, as a young person I don't know what to do…
There is still a lingering belief from classical machine learning that bigger models overfit and thus don't generalize well. This is described by the bias-variance trade-off, but this no longer holds in the new age of machine learning. This is empi…
Older AI models showed some capacity for generalization, but pre-O1 models weren't directly incentivized to reason. This fundamentally differs from humans: our limbic system can choose its reward function and reward us for making correct reasoning …
The relationship between human and artificial reasoning reveals an interesting tension in reward function design. While the human brain features a remarkably flexible reward system through its limbic system, current AI architectures rely on more rigid …
For the video of this, click here. Time and time again it's been proven that in the long run, scale beats any kind of performance gain we get from implementing smart heuristics; This idea is known as "The bitter lesson". The idea that we …
The Library of Babel greatly improved my intuitive understanding of how neural networks can learn. The Library of Babel is a library with every book imaginable in it. There lay the books with all possible combinations of words and thus all possible com…
