The worst prediction in physics | Don Lincoln and Lex Fridman
Don Lincoln and Lex Fridman discuss the 'worst prediction in physics' — the enormous discrepancy between quantum field theory's prediction of vacuum energy and the observed dark energy. Quantum field theory predicts a vacuum energy 10^120 times larger than what is measured. They explore why this problem is so difficult and what a theoretical solution might look like.
Summary
The conversation centers on one of the most embarrassing failures in modern physics: the vacuum energy problem, often called the 'worst prediction in physics.' Don Lincoln explains that while astronomical observations allow scientists to measure dark energy — a tiny but real energy density of empty space driving the universe's accelerating expansion — quantum field theory produces a wildly different answer when used to calculate what that vacuum energy should be.
Lincoln explains the source of the discrepancy: quantum field theory requires summing up the energy contributions of all wavelengths within a given volume, from the longest down to the shortest possible wavelengths. When you integrate all the way up to the Planck scale (the highest meaningful energy scale), the result is a vacuum energy 10^120 times larger than what dark energy observations show — a number so extreme it defies intuition.
He then offers a partial mitigation: if new physics were discovered at the energy scales accessible to current particle accelerators (roughly 10^15 times below the Planck scale), one would only need to integrate up to that lower energy cutoff. Since the energy term is raised to the fourth power, this reduces the discrepancy by (10^15)^4 = 10^60. But even this 'improved' prediction is still off by 60 orders of magnitude — still catastrophically wrong.
The conversation then turns to what a theoretical resolution might look like. Lincoln describes the challenge of imperfect cancellation: while it's relatively straightforward for theorists to hypothesize a new field that cancels the enormous vacuum energy to zero, dark energy is not zero — it's a small but nonzero value. So any canceling mechanism must leave behind exactly the right tiny residual, which is a much harder theoretical constraint than simple cancellation.
Finally, Lincoln outlines the general methodology theorists use: hypothesize an addition to existing equations that leaves all well-tested physics intact while resolving the problem area. The goal is to identify what a valid solution would look like structurally, which then guides more rigorous theoretical development.
Key Insights
- Lincoln explains that quantum field theory predicts a vacuum energy 10^120 times larger than the observed dark energy — derived from integrating all wavelength contributions to energy density up to the Planck scale, with the result scaling as the fourth power of the maximum energy.
- Lincoln argues that even if new physics were discovered at the energy scales of current accelerators — 10^15 times below the Planck scale — the discrepancy would only improve to 10^60 times the measured value, because the energy term scales to the fourth power: (10^15)^4 = 10^60.
- Lincoln distinguishes between two theoretical challenges: canceling the huge vacuum energy to exactly zero (which theorists can manage relatively easily) versus producing an imperfect cancellation that leaves behind the precise small nonzero value of observed dark energy, which he calls 'much harder.'
- Lincoln describes the standard theoretical methodology for addressing unsolved problems: hypothesize an addition to existing equations that makes negligible changes in regimes where measurements are already confirmed, while fixing the problematic prediction — essentially reverse-engineering the required properties of a solution before building a full theory.
- Lincoln suggests a possible solution structure: a new field that partially counteracts the energy contributions of known quantum fields — not canceling to zero, but leaving the observed small residual of dark energy — analogous conceptually to how matter and antimatter nearly balance each other.
Topics
Transcript
[0:02] But there is the what you call the worst prediction in physics, which is a nice >> That's another one. >> a nice little insight about the complicated nature of dark energy. So, the observations, as you described, say that empty space has a tiny energy density that accelerates expansion of the universe. But, quantum field theory's prediction for what vacuum energy should be when coupled with gravity is much [0:33] larger. Mhm. Uh so, this is what makes for the quote, you have a video on this, worst prediction in physics. Can you Can you explain this crisis? Well, there's a measurement, and you can measure how fast the universe is expanding, and from that you get a…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Do antipsychotic drugs work? | Andrew Scull and Lex Fridman
Andrew Scull discusses the efficacy and serious side effects of antipsychotic drugs, explaining that while they help some patients, many are non-responders, and the medications carry substantial risks including tardive dyskinesia, weight gain, metabolic syndrome, and cognitive dulling. The landmark CATIE study revealed that newer, expensive second-generation antipsychotics are no more effective than older first-generation drugs, with 67-82% of patients dropping out due to inefficacy or intolerable side effects.
Surprising origin of antipsychotic drugs | Andrew Scull and Lex Fridman
Andrew Scull explains how chlorpromazine, an antihistamine synthesized in the 1880s, was accidentally discovered to have psychiatric applications in the 1950s through French Navy lieutenant Alain Laborit's experiments. The drug's rapid adoption was driven by pharmaceutical companies' aggressive marketing to politicians and hospital administrators rather than by psychiatrists' initial enthusiasm, transforming it from a 'major tranquilizer' into the first 'antipsychotic' drug.
Cognitive Behavioral Therapy (CBT) vs Psychoanalysis | Andrew Scull and Lex Fridman
Andrew Scull discusses how clinical psychology and cognitive behavioral therapy (CBT) emerged after WWII as alternatives to psychoanalysis, becoming dominant through better empirical evidence, shorter treatment duration, and federal funding advantages. CBT's symptom-focused approach proved more measurable and reproducible than psychoanalytic theory, though its effectiveness remains limited for serious mental disorders.
Do anti-depressant drugs work? | Andrew Scull and Lex Fridman
Andrew Scull discusses the history and efficacy of antidepressants, particularly SSRIs like Prozac, explaining that while they statistically outperform placebo, the clinical improvement is often marginal and comes with significant side effects including sexual dysfunction and withdrawal difficulties. He also addresses 'diagnostic creep' in psychiatry, where conditions become increasingly broadly defined and diagnosed over time.
How drugs and psycho-pharmacology changed mental health | Andrew Scull and Lex Fridman
Andrew Scull traces the accidental discovery of psychopharmacology, beginning with chlorpromazine's unexpected psychiatric effects in the 1950s, and discusses how pharmaceutical companies transformed mental health treatment while also introducing serious side effects like tardive dyskinesia and metabolic complications that remain inadequately addressed.