The worst prediction in physics | Don Lincoln and Lex Fridman
Don Lincoln and Lex Fridman discuss the 'worst prediction in physics' — the enormous discrepancy between quantum field theory's prediction of vacuum energy and the observed dark energy. Quantum field theory predicts a vacuum energy 10^120 times larger than what is measured. They explore why this problem is so difficult and what a theoretical solution might look like.
Summary
The conversation centers on one of the most embarrassing failures in modern physics: the vacuum energy problem, often called the 'worst prediction in physics.' Don Lincoln explains that while astronomical observations allow scientists to measure dark energy — a tiny but real energy density of empty space driving the universe's accelerating expansion — quantum field theory produces a wildly different answer when used to calculate what that vacuum energy should be.
Lincoln explains the source of the discrepancy: quantum field theory requires summing up the energy contributions of all wavelengths within a given volume, from the longest down to the shortest possible wavelengths. When you integrate all the way up to the Planck scale (the highest meaningful energy scale), the result is a vacuum energy 10^120 times larger than what dark energy observations show — a number so extreme it defies intuition.
He then offers a partial mitigation: if new physics were discovered at the energy scales accessible to current particle accelerators (roughly 10^15 times below the Planck scale), one would only need to integrate up to that lower energy cutoff. Since the energy term is raised to the fourth power, this reduces the discrepancy by (10^15)^4 = 10^60. But even this 'improved' prediction is still off by 60 orders of magnitude — still catastrophically wrong.
The conversation then turns to what a theoretical resolution might look like. Lincoln describes the challenge of imperfect cancellation: while it's relatively straightforward for theorists to hypothesize a new field that cancels the enormous vacuum energy to zero, dark energy is not zero — it's a small but nonzero value. So any canceling mechanism must leave behind exactly the right tiny residual, which is a much harder theoretical constraint than simple cancellation.
Finally, Lincoln outlines the general methodology theorists use: hypothesize an addition to existing equations that leaves all well-tested physics intact while resolving the problem area. The goal is to identify what a valid solution would look like structurally, which then guides more rigorous theoretical development.
Key Insights
- Lincoln explains that quantum field theory predicts a vacuum energy 10^120 times larger than the observed dark energy — derived from integrating all wavelength contributions to energy density up to the Planck scale, with the result scaling as the fourth power of the maximum energy.
- Lincoln argues that even if new physics were discovered at the energy scales of current accelerators — 10^15 times below the Planck scale — the discrepancy would only improve to 10^60 times the measured value, because the energy term scales to the fourth power: (10^15)^4 = 10^60.
- Lincoln distinguishes between two theoretical challenges: canceling the huge vacuum energy to exactly zero (which theorists can manage relatively easily) versus producing an imperfect cancellation that leaves behind the precise small nonzero value of observed dark energy, which he calls 'much harder.'
- Lincoln describes the standard theoretical methodology for addressing unsolved problems: hypothesize an addition to existing equations that makes negligible changes in regimes where measurements are already confirmed, while fixing the problematic prediction — essentially reverse-engineering the required properties of a solution before building a full theory.
- Lincoln suggests a possible solution structure: a new field that partially counteracts the energy contributions of known quantum fields — not canceling to zero, but leaving the observed small residual of dark energy — analogous conceptually to how matter and antimatter nearly balance each other.
Topics
Full transcript available for MurmurCast members
Sign Up to Access