The worst prediction in physics | Don Lincoln and Lex Fridman
Don Lincoln and Lex Fridman discuss the 'worst prediction in physics' — the enormous discrepancy between quantum field theory's prediction of vacuum energy and the observed dark energy. Quantum field theory predicts a vacuum energy 10^120 times larger than what is measured. They explore why this problem is so difficult and what a theoretical solution might look like.
Summary
The conversation centers on one of the most embarrassing failures in modern physics: the vacuum energy problem, often called the 'worst prediction in physics.' Don Lincoln explains that while astronomical observations allow scientists to measure dark energy — a tiny but real energy density of empty space driving the universe's accelerating expansion — quantum field theory produces a wildly different answer when used to calculate what that vacuum energy should be.
Lincoln explains the source of the discrepancy: quantum field theory requires summing up the energy contributions of all wavelengths within a given volume, from the longest down to the shortest possible wavelengths. When you integrate all the way up to the Planck scale (the highest meaningful energy scale), the result is a vacuum energy 10^120 times larger than what dark energy observations show — a number so extreme it defies intuition.
He then offers a partial mitigation: if new physics were discovered at the energy scales accessible to current particle accelerators (roughly 10^15 times below the Planck scale), one would only need to integrate up to that lower energy cutoff. Since the energy term is raised to the fourth power, this reduces the discrepancy by (10^15)^4 = 10^60. But even this 'improved' prediction is still off by 60 orders of magnitude — still catastrophically wrong.
The conversation then turns to what a theoretical resolution might look like. Lincoln describes the challenge of imperfect cancellation: while it's relatively straightforward for theorists to hypothesize a new field that cancels the enormous vacuum energy to zero, dark energy is not zero — it's a small but nonzero value. So any canceling mechanism must leave behind exactly the right tiny residual, which is a much harder theoretical constraint than simple cancellation.
Finally, Lincoln outlines the general methodology theorists use: hypothesize an addition to existing equations that leaves all well-tested physics intact while resolving the problem area. The goal is to identify what a valid solution would look like structurally, which then guides more rigorous theoretical development.
Key Insights
- Lincoln explains that quantum field theory predicts a vacuum energy 10^120 times larger than the observed dark energy — derived from integrating all wavelength contributions to energy density up to the Planck scale, with the result scaling as the fourth power of the maximum energy.
- Lincoln argues that even if new physics were discovered at the energy scales of current accelerators — 10^15 times below the Planck scale — the discrepancy would only improve to 10^60 times the measured value, because the energy term scales to the fourth power: (10^15)^4 = 10^60.
- Lincoln distinguishes between two theoretical challenges: canceling the huge vacuum energy to exactly zero (which theorists can manage relatively easily) versus producing an imperfect cancellation that leaves behind the precise small nonzero value of observed dark energy, which he calls 'much harder.'
- Lincoln describes the standard theoretical methodology for addressing unsolved problems: hypothesize an addition to existing equations that makes negligible changes in regimes where measurements are already confirmed, while fixing the problematic prediction — essentially reverse-engineering the required properties of a solution before building a full theory.
- Lincoln suggests a possible solution structure: a new field that partially counteracts the energy contributions of known quantum fields — not canceling to zero, but leaving the observed small residual of dark energy — analogous conceptually to how matter and antimatter nearly balance each other.
Topics
Transcript
[0:02] But there is the what you call the worst prediction in physics, which is a nice >> That's another one. >> a nice little insight about the complicated nature of dark energy. So, the observations, as you described, say that empty space has a tiny energy density that accelerates expansion of the universe. But, quantum field theory's prediction for what vacuum energy should be when coupled with gravity is much [0:33] larger. Mhm. Uh so, this is what makes for the quote, you have a video on this, worst prediction in physics. Can you Can you explain this crisis? Well, there's a measurement, and you can measure how fast the universe is expanding, and from that you get a…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Sex in the Roman Empire | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses Justinian I's reign, focusing on his meritocratic appointment of talented individuals regardless of social class (including his wife Theodora, a former sex worker), his monumental codification of Roman law through the Corpus Juris Civilis, and the paradox of his harsh stance on sexuality despite his own unconventional personal choices.
Did the plague kill half the Roman Empire? | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses the Plague of Justinian (541 AD), arguing against the maximalist claim that it killed 50% of the Roman population. He contends that modern pathogen identification combined with historical evidence shows the plague had far less impact than commonly assumed, as evidenced by Justinian's continued military campaigns and taxation during the outbreak.
Persian Empire vs Roman Empire: The war that destroyed both empires | Anthony Kaldellis
Anthony Kaldellis discusses the Byzantine-Persian War (602-628 CE) and its catastrophic consequences for both empires, explaining how Heraclius's civil war weakened Roman defenses, the eventual Arab conquests stripped away the empire's richest provinces, and the subsequent Byzantine survival through military innovation like Greek fire and strategic defensive reorganization.
Why the Roman Empire collapsed in the East | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses how the Eastern Roman Empire, despite territorial losses, maintained remarkable internal stability and could have lasted another thousand years without external invasions. He attributes this resilience to two factors: authorities convincingly persuading subjects they ruled on their behalf, and a unified Roman and Orthodox identity that made the alternatives to imperial rule seem worse.
Lessons from the Roman Empire for modern-day - historian explains | Anthony Kaldellis
Historian Anthony Kaldellis discusses lessons from the 2,200-year Roman Empire for modern America, focusing on the importance of building lasting institutions that serve the majority, aligning foreign policy rhetoric with actual military actions, and the persistent elements of human nature across centuries.