Is dark matter real? - Why can't we find it? - physicist explains | Don Lincoln and Lex Fridman

The conversation opens with Don Lincoln explaining what is often called the 'worst prediction in physics': quantum field theory predicts a vacuum energy density that is 10^120 times larger than the observed dark energy. This arises because when you sum up the energy contributions of all wavelengths of quantum fields — down to the shortest — the result is astronomically large due to the fourth-power dependence on the energy cutoff. Even if new physics appears at the energy scales accessible to the LHC, reducing the required integration range by a factor of 10^15, the discrepancy would still be 10^60, which Lincoln describes as 'still pretty bleeding big.'

Lincoln discusses possible theoretical solutions, including hypothesizing a new field that nearly — but not perfectly — cancels out the vacuum energy, leaving just the small observed dark energy. He notes that perfect cancellation is easy for theorists but imperfect cancellation is much harder to justify. He also speculates, with heavy caveats, that dark energy may be a property of space itself rather than a field within space, particularly because its energy density appears to remain constant as space expands — which would be strange for a conventional field but natural if new quanta of space are continuously appearing, each carrying a fixed amount of energy.

The discussion then shifts to dark matter. Lincoln identifies three independent astronomical observations that suggest something is wrong with our understanding of either gravity or the matter content of the universe: galaxies spin too fast, galaxy clusters move too quickly, and gravitational lensing of distant galaxies doesn't match predictions from visible matter alone. He outlines the logical possibilities — wrong law of gravity, wrong law of inertia, or missing mass — and describes how early candidates like hydrogen gas, rogue planets, and black holes have been ruled out.

Lincoln explains why two specific observations shifted his view toward dark matter being real. The Bullet Cluster, where two galaxy clusters passed through each other, showed gravitational distortions tracking the galaxies rather than the gas clouds — exactly what dark matter predicts. The Dragonfly galaxies (DF2 and DF4), which rotate in perfect agreement with Newton's laws without requiring dark matter, paradoxically support dark matter's existence because they suggest dark matter can be absent in some galaxies, implying it is a separable component rather than a modification of gravity.

Despite believing dark matter is likely real, Lincoln acknowledges that all three detection strategies — direct detection via underground detectors, indirect detection via gamma rays from annihilation, and collider production — have so far come up empty. The viable mass range for a dark matter particle spans from asteroid-mass to far lighter than an electron, and only small patches of that enormous parameter space have been explored. Lincoln expresses hope that dark matter will be understood in his lifetime, while acknowledging that the prolonged failure to detect it has led some physicists to strongly favor modified gravity theories instead.