Why LLMs Might Hit a Wall - Noam Brown
Noam Brown argues that LLMs face a fundamental scaling challenge: as models become more intelligent, most available tasks become too easy to provide meaningful learning signals. Unlike game-playing AIs that learn through self-play against equally matched opponents, current reinforcement learning methods for LLMs struggle when tasks are trivial, potentially hitting a wall despite existing workarounds.
Summary
Noam Brown presents a critical analysis of LLM development trajectories compared to game-playing AIs like AlphaGo and AlphaZero. He identifies an interesting paradox: as language models become increasingly intelligent, the questions and tasks available to train them become progressively easier for the models to solve. This creates a learning bottleneck because the model cannot extract meaningful training signal from problems it solves trivially.
Brown contrasts this with game-playing AIs, which overcome this challenge through self-play mechanisms. In self-play, the AI always faces an opponent of equivalent strength, ensuring continuous challenge regardless of the AI's absolute skill level. This creates an endless source of appropriately-calibrated training data.
For current reinforcement learning approaches applied to LLMs, the dynamic is different. When a model receives a task, it either solves it quickly (learning nothing) or fails to solve it. There is no built-in mechanism for scaling difficulty automatically. Brown acknowledges this represents a genuine constraint on progress—if the field exhausts challenging tasks, advancement could become significantly more difficult.
However, Brown tempers this concern by noting that potential solutions likely exist, suggesting the scenario, while real, is not necessarily insurmountable.
Key Insights
- As models become increasingly intelligent, most questions available to ask them become too easy, which prevents the model from learning anything new from trivial solutions
- Game-playing AIs like AlphaGo and AlphaZero overcome capability plateaus through self-play, where the AI always faces an opponent of equal strength regardless of absolute skill level
- Current reinforcement learning methods for LLMs lack the self-scaling mechanism of self-play; they depend on external task provision rather than self-generated challenges
- If challenging tasks become exhausted, making progress on LLM capabilities could become substantially more difficult due to lack of meaningful training signal
- Despite the real possibility of this scenario occurring, Brown believes viable solutions exist to circumvent the task exhaustion problem
Topics
Transcript
[0:00] There is an interesting problem: as models become increasingly intelligent, most of the questions we can ask them become too easy. And, um, it 's hard to challenge that model. If I had to explain why LLMs might not go the same way as AlphaGo, AlphaZero and other gaming AIs, where there is self-learning and an endless training program. You always play against an AI that is just as strong as you. Whereas for reinforcement learning LLM, at least with the methods that exist now, you give the model a problem and ask it to solve it. And if the task is [0:30] so easy that the model solves it in a second, it doesn't learn anything new .…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Dwarkesh Patel
The Army Sent to Stop Cortés Joined Him Instead - Si Sheppard
Spanish conquistador Cortés faced a threat from Governor Velázquez of Cuba, who sent Don Narvaez with a larger force to arrest him for exceeding his authority. Rather than being defeated, Cortés defeated Narvaez in battle and persuaded the expeditionary force to join him by promising shared wealth from the empire, turning potential enemies into reinforcements.
How 168 Men Captured the Inca Emperor - Si Sheppard
Francisco Pizarro, with only 168 men, captured the Inca Emperor Atahualpa in 1532 at Cajamarca by using psychological tactics with horses and an ambush strategy. Despite Atahualpa's show of dominance and his large army, Pizarro's surprise attack and capture of the emperor allowed him to control the entire Inca social hierarchy.
The Myth of the Helpless Aztecs and Inca - Si Sheppard
Si Sheppard argues that the Aztecs and Incas were not helpless victims but actively developed countermeasures and adaptive strategies against Spanish conquistadors, including terrain manipulation, weapon improvisation, and tactical learning—though they lacked sufficient time to fully master foreign technologies.
How Conquistadors Conquered the Aztecs - Si Sheppard
Conquistador success against the Aztecs relied primarily on steel weapons, horses, and psychological tactics rather than firearms. Steel armor and swords proved far more effective than indigenous weapons made of wood, stone, and obsidian, while horses—animals unknown to the Aztecs—provided decisive military and logistical advantages.
How did a few hundred Spanish soldiers topple two empires? – Si Sheppard
Military historian Si Sheppard explains how a few hundred Spanish conquistadors were able to conquer the Aztec and Inca Empires within just a few years through a combination of technological advantages (horses, steel weapons), psychological warfare, diplomatic manipulation of existing divisions among indigenous peoples, and the catastrophic impact of disease. The conquests were contingent on individual leadership decisions and geographic factors, but were fundamentally enabled by the conquistadors' ability to exploit internal rifts within empires that appeared monolithic from the outside.