Daniel Litt: The Mathematician's Guide to AI
Daniel Litt, a mathematician at University of Toronto, discusses AI's evolving capabilities in mathematics, distinguishing between what models can do well (applying known techniques, solving specific problems) versus where they fall short (developing intuition, building new theories, asking fundamental questions). He emphasizes that while AI results are impressive, the mathematics community must adapt its incentive structures to preserve human understanding and maintain cognitive diversity in mathematical research.
Summary
In this A16Z Infra podcast episode, Daniel Litt provides a nuanced analysis of AI's current and future role in mathematics. He begins by identifying his favorite fully autonomous AI result: the solution to the Erdős unit distance problem, which he considers creative because it brought techniques from the 1960s into a new domain and subsequently enabled solutions to other open problems.
Litt establishes a taxonomy of AI mathematical capabilities, noting that models excel at applying known techniques across multiple domains and handling long computations, but struggle with fuzzy activities like intuition development, theory building, and determining which questions are worth asking. He describes the models' output as "very human" in character—recognizable chain-of-thought reasoning that doesn't appear inhuman or require unexplainable leaps. He notes that both Claude and ChatGPT solve similar collections of problems, representing a relatively narrow band of mathematical activity.
A critical distinction Litt makes is between solving a problem and understanding it. He explains that his own work involves developing non-rigorous philosophies, analogies, and fuzzy reasoning to guide precise mathematical development. When models struggle with a problem, he's found that working through examples and discovering a better statement of the lemma—something models initially couldn't prove—led to more elegant proofs than the brute-force grinding approach the models could have taken.
Regarding his own mathematical practice, Litt describes himself as a problem solver motivated by understanding rather than aesthetics. He works on problems like the Gross-Sacks p-curvature conjecture, viewing them as benchmarks of ignorance. His approach involves finding small situations where understanding breaks down, developing theory to address them, and building analogies across mathematical domains. He notes that problems he's worked on for 3-5 years remain largely inaccessible to current models, as they likely require developing new techniques rather than applying existing ones.
Litt discusses how AI is actually affecting his daily work. Projects predating AI remain largely unaffected—he uses models primarily as a substitute for Google when learning related topics. However, AI has enabled him to pursue coding-intensive projects he previously avoided, demonstrating how the technology shifts which projects become feasible rather than accelerating existing ones.
On the comparative development of Claude and ChatGPT models, Litt notes they appear roughly equivalent in capabilities, with ChatGPT having reached useful performance for research mathematics earlier. He observes that ChatGPT 5.6 provides clearer exposition and better theory-of-mind regarding what the user knows, though both models are "pretty bad" at theory of mind generally.
A significant portion of the discussion addresses institutional and community-level concerns. Litt expresses worry about emerging incentive misalignment in mathematics: postdocs on the job market can now generate multiple papers by having models attempt proofs of recent conjectures (what he calls "playing the slot machine"), without developing genuine understanding. He's documented instances of three to five identical papers proving the same theorem being posted within days, indicating mode collapse in the models' reasoning. This threatens what he sees as mathematics' core value: letting "a thousand different flowers bloom" as people pursue diverse curiosities, which collectively expands knowledge boundaries.
Litt articulates why this diversity matters: mathematical progress depends on humans bringing varied intuitions, asking different questions, and developing understanding that can cross-pollinate unexpected domains. If mathematical research becomes dominated by what models naturally pursue—technically strong application of known techniques—the field may lose the generative diversity that enables breakthroughs.
Regarding the future, Litt remains confident that AI capabilities will continue advancing and may eventually develop theory-building abilities through improved reinforcement learning environments and curricula based on varying-difficulty conjectures. However, he emphasizes that optimal AI performance doesn't guarantee optimal societal outcomes. Institutions must actively design incentive structures to preserve human engagement with mathematics and maintain the pipeline of people developing mathematical thinking skills.
Litt also discusses the issue of proof verification and length. Models produce short, clever proofs because those are what can be checked; longer proofs may contain undetected errors. The recent 800-page AI-generated claimed proof of resolution of singularities exemplifies this—while impossible to verify, it clearly exceeds current model capabilities for rigorous arguments. This suggests published short results may overrepresent models' true capabilities.
On a personal note, Litt describes his approach to his three-year-old daughter's mathematics education, emphasizing conceptual understanding over grinding. He expresses hope that core values of mathematical thinking—clear reasoning and better understanding the world—remain relevant regardless of AI advancement, while acknowledging that educational institutions may require substantial adaptation.
About this episode
a16z’s Lisha Li sits down with Daniel Litt, Assistant Professor of Mathematics at the University of Toronto, to unpack AI's rapid progress in mathematics, what today's frontier models can actually do, and what they're still missing about the way mathematicians think. Daniel explains why some recent AI-generated results are genuinely impressive, including an autonomous solution to the Erdős unit distance problem, but argues that solving problems is only one part of mathematics. Today's models can grind through calculations, combine known techniques, and search enormous spaces, but still struggle with intuition, theory building, identifying the right questions, and developing the kind of big-picture understanding that drives much of mathematical progress. Lisha and Daniel also explore how AI is already changing mathematical research, why an explosion of AI-generated papers could distort academic incentives, and what happens if researchers outsource the work of thinking rather than use AI to deepen it. Ultimately, they ask a question that extends far beyond mathematics: as AI gets better at intellectual work, how do we make sure humans keep getting better at thinking too?
Key Insights
- Litt identifies the Erdős unit distance problem solution as the most impressive autonomous AI result in mathematics because it unexpectedly transferred techniques from the 1960s to a new domain, subsequently enabling solutions to other open problems—a mark of genuine creativity beyond technical application.
- Models are described as stronger at applying known techniques across multiple domains and performing long computations, but weaker at developing intuition, building new theories, and determining which questions are worth asking—a narrow band of mathematical activity.
- Litt argues that the models' chain-of-thought reasoning appears recognizably human rather than alien, suggesting their reasoning style parallels human mathematical thinking in style if not depth.
- When Litt worked with models that couldn't prove a lemma, he discovered a better statement of the lemma through working examples independently, resulting in more elegant conceptual proofs than the grinding calculations models could have produced—demonstrating how limitations can drive deeper understanding.
- Litt's pre-AI work on long-standing problems remains largely inaccessible to models because these problems likely require developing new mathematical techniques rather than applying existing ones skillfully.
- Models have shifted which projects are feasible for Litt rather than accelerating existing work—his newfound ability to delegate coding enabled coding-intensive projects he previously avoided, rather than speeding up his core mathematical pursuits.
- The academic job market is creating misaligned incentives where postdocs can generate multiple papers by having models prove recent conjectures without developing genuine understanding—what Litt calls 'playing the slot machine.'
- Identical papers proving the same theorem appeared multiple times within days on arxiv, indicating the models converge on similar proofs rather than exploring diverse mathematical approaches—a form of mode collapse problematic for the field.
- Mathematical progress historically depends on cognitive diversity from many people pursuing different curiosities; if AI research becomes dominated by what models naturally excel at, the field risks losing the generative diversity enabling breakthroughs.
- Models produce short, clever proofs primarily because longer proofs are harder to verify for correctness, not necessarily because models prefer elegance—evident from the unpublished longer, grinding proofs they generate that may contain undetected errors.
- Litt challenges the assumption that optimal AI performance guarantees optimal societal outcomes, arguing that institutions must actively design incentive structures to preserve human engagement with mathematics and maintain the human capital pipeline.
- The core value of mathematics—clear thinking and understanding the world—may remain relevant regardless of AI advancement, but educational institutions require substantial adaptation to preserve this value while integrating AI tools.
Topics
Transcript
The goal of mathematics is not to produce mathematics papers, it's to produce some kind of understanding. Maybe some of that understanding resides in model weights. To me, that's pretty unsatisfying. Comparing anthropic with open AI, do you detect any differences in how that is similar to human reasoning? They definitely are not good at it autonomously, but with some hints, you can get them to do something interesting. A lot of progress in mathematics comes from letting a thousand different flowers bloom and people pursue their own curiosity and then the boundaries of knowledge expand in some fairly uniform way. What has been the most impressive result so far? My favorite fully autonomous result by an AI so far…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The a16z Show
The Top 100 Consumer AI Apps: Who’s Actually Paying?
A16Z's seventh edition Top 100 Consumer AI Apps Report reveals that while half of Americans use AI, only 4.5% pay for subscriptions, with spending heavily concentrated among developers and power users. The report highlights emerging personal agents as a major trend, significant divergence between ChatGPT, Claude, and Gemini, and substantial untapped opportunities in categories like dating, social, shopping, and entertainment.
David George & Jack Altman on AI, Autonomy, and the Next $25 Trillion
David George from Andreessen Horowitz argues that AI, autonomy, and robotics will create over $25 trillion in market value over the next decade, with success across multiple layers of the stack—frontier models, open source, and applications will all flourish due to massive supply constraints and early-stage demand penetration among knowledge workers.
Beyond the God Model | Alex Atallah & Amjad Masad
Alex Atallah (OpenRouter) and Amjad Masad (Replit) discuss how the future of AI development lies in specialized, diverse models working together rather than relying on single AGI-like models. They argue that enterprises need independence from foundation model providers through model diversity, cost efficiency, and ownership of their own AI capabilities, while also addressing the risks of general-purpose agents and the importance of model specialization.
Why AI Agents Can Beat the Incumbents
Leo, an AI-native startup, is building multi-agent systems to automate end-to-end procurement processes for enterprises by coordinating work across multiple departments, stakeholders, and external systems that traditional procurement software cannot handle. The company differentiates itself from incumbents by owning the entire job workflow rather than being confined to a single system of record, and builds customer trust through human-in-the-loop approaches before scaling to fully autonomous negotiations.
The $1 Trillion AI Buildout | State of Markets
A16Z partners discuss the $1 trillion AI infrastructure buildout, arguing it's driven by real earnings growth rather than inflated valuations, with adoption still extremely early at the enterprise level. They highlight opportunities across consumer agents, robotics, autonomous vehicles, and enterprise diffusion, while noting that the market's 90% gain since ChatGPT reflects fundamental business performance rather than speculative excess.