Michael Nielsen – How science actually progresses
Michael Nielsen discusses the complex nature of scientific progress, exploring how scientific theories actually develop through history using examples like special relativity and Darwinism. He argues that science progresses through unpredictable processes rather than simple falsification, and examines how AI might accelerate scientific discovery.
Summary
This wide-ranging conversation covers the messy reality of scientific progress versus popular narratives. Nielsen begins by deconstructing the standard story of the Michelson-Morley experiment, explaining that it was actually designed to test different theories of the ether rather than disprove its existence entirely. Einstein likely wasn't even influenced by the experiment when developing special relativity. The discussion explores how falsification works in practice - showing that theories can be modified rather than abandoned when faced with contrary evidence, and that verification loops can be extremely long (like the 85 years it took to understand isotopes in Prout's hypothesis). Nielsen argues that scientific progress happens through diverse research programs running in parallel, with breakthrough moments that can't be easily predicted or automated. The conversation then shifts to the nature of scientific explanation itself, comparing traditional theories like general relativity to modern AI models like AlphaFold, questioning whether large parameter models constitute genuine scientific explanations or represent a new category of scientific object. Nielsen speculates that the 'technology tree' of possible discoveries is vast and largely unexplored, suggesting that different civilizations might develop entirely different technological stacks. This has implications for potential gains from trade between civilizations. The discussion concludes with practical advice about learning and research methodology, emphasizing the importance of engaging with demanding creative contexts rather than superficial understanding.
Key Insights
- The Michelson-Morley experiment was actually designed to test different theories of the ether against each other rather than disprove its existence, and Einstein may not have even been influenced by it when developing special relativity
- Lorentz developed the mathematical transformations underlying special relativity but interpreted them as effects of moving through the ether, showing that the same math can support different physical interpretations
- Scientific verification loops can be extremely long and hostile - Prout's hypothesis about atomic weights took 85 years to be vindicated through the discovery of isotopes, during which the evidence actively seemed to contradict the theory
- AlphaFold's success is primarily a story of massive data acquisition through decades of protein structure determination, with the AI component being a relatively small fraction of the total scientific investment
- The technology tree of possible discoveries is likely vast and largely unexplored, meaning different alien civilizations would probably develop entirely different technological stacks, creating massive potential gains from trade
Topics
Transcript
[0:00] Today, I'm speaking with Michael Nielsen. You have done many things. You're one of the pioneers of quantum computing, wrote the main textbook in the field of the open science movement. You wrote a book about deep learning that Chris Olah and Greg Brockman credit with getting them into the field. More recently, you're a research fellow at the Astera Institute and writing a book about religion, science, and technology. I'm going to ask you about none of those things. The conversation I want to have today is, how do we recognize scientific progress? It's especially relevant for AI because [0:31] people are trying to close the RL verification loop on scientific discovery. What does it mean to close…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Dwarkesh Patel
Britain turned its biggest weakness into the source of its power - Sarah Paine
Sarah Paine explains how Britain's island geography and dependence on trade, initially weaknesses, became strategic advantages that allowed it to build maritime power while competitors exhausted themselves maintaining large standing armies. Britain's naval dominance enabled wealth accumulation over time, creating an expanding economic gap with continental rivals.
Botox Makes You Worse at Reading Emotions - Grant Sanderson
Grant Sanderson discusses a Botox study showing that people with paralyzed facial muscles perform worse at reading emotions in others. He argues that emotional understanding relies partly on mimicking facial expressions, and suggests AI models similarly lack theory of mind because they cannot physically embody or mimic human experiences.
Mathematicians will become art curators - Grant Sanderson
Grant Sanderson argues that mathematicians' future role will shift toward being curators of mathematical ideas rather than solvers, helping navigate an infinite space of concepts. He contends that even if AI becomes superior at explanation, humans will remain valuable for the social and relational aspects of knowledge sharing, similar to how human musicians retain relevance despite advanced audio technology.
Why Russia Never Stops Expanding - Sarah Paine
Historian Sarah Paine explains Russian imperial expansion through the lens of 19th-century Russian historian Vasili Kucheski, who viewed Russia's history as continuous self-colonization. The analysis reveals that Russian geopolitical strategy is driven by a security logic where weak neighbors are vulnerable to absorption and strong neighbors become threats, necessitating constant territorial expansion.
The reason Russia and China can't win at sea - Sarah Paine
Sarah Paine argues that Russia and China lack the necessary prerequisites for maritime dominance, including protection from invasion, dense internal transportation networks, reliable sea access, dense coastal populations, commerce-driven economies, and stable democratic institutions. Despite their maritime ambitions, neither country possesses the full set of conditions required for a successful maritime paradigm.