OpenAI Researchers on the Future of Mathematical Reasoning
OpenAI researchers discuss how AI models are making progress on long-standing mathematical problems by combining literature knowledge, executing complex proofs with precision, and exploring multiple approaches without human cognitive biases. They present case studies in sphere packing, coding theory, and group theory, arguing that AI's ability to persist through difficult problems and leverage symmetry properties is fundamentally changing what mathematics gets solved and how it's practiced.
Summary
In this episode of the A16Z Podcast, host Leisha Li interviews OpenAI mathematicians Mark Selke and Metab Swani about how large language models are advancing mathematical research. The discussion begins with how AI differs from human mathematicians: while humans often abandon approaches after hours or weeks of unsuccessful attempts, AI models persist doggedly without the psychological burden of sunk costs. The researchers describe a moment of breakthrough when GPT-5 rapidly identified whether an Erdős problem was still unsolved by finding relevant literature—a task that had frustrated them for hours. They then discovered 10 similar cases where AI provided crucial connections across fields.
The conversation shifts to recent accomplishments announced through Astra, OpenAI's mathematical reasoning system. The first major result concerns sphere packing in high dimensions. The researchers explain that while sphere packing in 2D (hexagonal lattice) and 3D (grocery store oranges) have solutions, the general problem remains largely mysterious. The optimal packings are only known in five dimensions (1, 2, 3, 8, and 24), with dimensions 8 and 24 corresponding to special mathematical structures (E8 and Leach lattices) that emerged from other areas of mathematics. Previous bounds on sphere packing density in high dimensions, established in the 1970s, used ugly combinatorial optimization arguments and yielded the unintuitive number 2^(-0.599d).
Astra's breakthrough was analyzing the linear programming (LP) bound for sphere packing, a framework developed by Cohn and Elkies. The model was asked to understand how this bound behaves in large dimensions and discovered an elegant asymptotic formula: the bound equals 2^(-(2π + o(1))d), approximately 2^(-0.601d). Crucially, the model proved this is the optimal bound achievable through LP methods—not just a better guess, but a complete characterization. The proof uses complex analysis and is surprisingly short. The researchers emphasize this represents genuine mathematical reasoning: the model identified the right direction to pursue among many possibilities, much like a human mathematician recognizing a promising approach.
The second result concerns spherical codes and binary error-correcting codes, which are dual problems to sphere packing. These are highly relevant to practical communication systems. The model improved bounds for both cases using representation theory—leveraging the symmetry properties of spheres and hypercubes. Interestingly, this was one case where interaction occurred: the researchers asked the model to improve code bounds, then prompted it to push further. The model's more sophisticated representation theory approach ultimately recovered the conjectured value for the original sphere packing problem, revealing a deep connection between the problems. The researchers speculate this interaction may become unnecessary as models improve.
The third major result addresses SOFIC groups, an abstract algebra question. A group is SOFIC if it can be approximated by finite groups—analogous to how the integers can be approximated by integers modulo n. For decades, mathematicians hoped every group was SOFIC, reasoning that finite approximations should work universally. This relates to the famous Aldous-Lyons conjecture about approximating graphs. A counterexample disproving Aldous-Lyons required 250 pages building on prior 200-page work, involving quantum complexity theory. However, Astra produced a direct 15-page proof that non-SOFIC groups exist using only group theory. The proof identifies a delicate combinatorial obstruction that previous researchers had implicitly identified but couldn't rule out. By adding one algebraic fact, the model prevented the "conspiracy" that previous authors couldn't eliminate.
The researchers discuss key differences between AI and human mathematics. Humans often become cognitively locked into failed approaches, unable to properly restart exploration in a new direction without their "context window" being polluted by prior failures. AI can easily spawn parallel sessions exploring different paths. Additionally, AI excels at executing proofs once a general direction is identified—getting epsilon smaller than delta, maintaining algebraic precision—details where humans easily get lost. The researchers note AI seems better at updating how promising a path is versus simply rejecting it, and can make good decisions about which approaches to pursue based on combining existing knowledge with mathematical judgment.
On the question of AI producing genuinely mathematical reasoning versus sophisticated guessing, the researchers present evidence from reasoning traces. The chains of thought read surprisingly like notes from human mathematicians—not alien logic but recognizable mathematical thinking. This emerges from training reasoning models to think deeply, not from domain-specific mathematical training tricks. The researchers note that mathematical proofs are surprisingly short and elegant, contrary to fears of thousand-page incomprehensible AI solutions.
The conversation explores how mathematics will change as proving results becomes less of a bottleneck. Previously, the person proving a result also gained deep understanding and bore responsibility for explaining it. With AI handling proofs more readily, different skills become valuable: understanding results deeply enough to communicate them to others, maintaining communal knowledge, recognizing which problems matter, and demonstrating mathematical taste in directing research. The researchers suggest this could democratize mathematics—people without full-time mathematics careers could understand deep results by using AI to absorb complex papers. They emphasize that even exponential AI improvement won't trivialize everything: hard unsolved problems like P versus NP should remain challenging indefinitely.
The researchers also discuss the practical impact on working mathematicians. One finds it much faster to input a paper PDF and have a model explain the proof strategy than to read carefully. This addresses the problem that AI creates: the explosion of results is simultaneously solved by AI's ability to help absorb mathematics. The mathematical community has begun building on these results—notably, researchers Kuhn and Tom (whose prior work Astra built upon) have already published follow-up work exploring more examples of non-SOFIC groups. The researchers express hope that the community will continue this pattern rather than viewing AI results as endpoint achievements.
About this episode
a16z Infra Partner Lisha Li sits down with OpenAI mathematicians Mehtaab Sawhney and Mark Sellke to discuss how quickly AI’s mathematical capabilities are advancing, what recent results reveal about model reasoning, and what happens when AI begins making progress on problems mathematicians have struggled with for decades. Mehtaab and Mark unpack several recent results from OpenAI’s models, including advances in sphere packing and the construction of a non-sofic group. They explain why the surprising part isn’t simply that models can search more possibilities or work longer than humans: in many cases, the reasoning traces look remarkably similar to the work of an expert mathematician, including choosing promising approaches, backtracking when they fail, and combining ideas from across the literature. They also explore what this means for mathematics itself: how the role of human taste and judgment may change, whether AI could produce far more mathematics than humans can absorb, and why models that accelerate discovery may also make sophisticated results easier to understand.
Key Insights
- AI models solve mathematical problems humans abandon by persisting through difficult approaches without the psychological burden of sunk costs that discourages human mathematicians from continuing after weeks of failed attempts.
- AI excels at two distinct capabilities in mathematics: first, rapidly connecting insights across literature and fields (a task frustratingly slow for humans), and second, executing complex proofs with perfect precision on details like epsilon-delta arguments where humans frequently get lost.
- The sphere packing breakthrough represents genuine mathematical reasoning rather than brute force: Astra identified the linear programming bound as the key analytical framework and proved both an elegant asymptotic formula and that this bound is optimal—requiring mathematical judgment about which direction to pursue among many possibilities.
- AI demonstrates better updating of pathway viability than humans: when approaches fail, the model reassesses likelihood more accurately than humans, who tend to permanently downgrade rejected paths in memory, whereas AI can spawn parallel sessions to reconsider without cognitive pollution.
- Mathematical reasoning in AI emerges from training for general-purpose reasoning over long contexts, not from domain-specific mathematical techniques, and exhibits patterns like backtracking and pruning that appear across reasoning domains beyond mathematics.
- The sphere packing result solved a mystery that had puzzled mathematicians: previous bounds from the 1970s yielded an apparently arbitrary number (2^-0.599d), but Astra revealed this came from an optimization problem and found the LP bound achieves 2^-(2π+o(1))d, proving this is optimal.
- AI produced a 15-page proof disproving that all groups are SOFIC, whereas the only prior counterexample to the related Aldous-Lyons conjecture required 250 pages of quantum complexity theory, suggesting AI finds more direct paths through mathematical problem spaces.
- The mathematical community is already building follow-up work on AI results: researchers whose prior work Astra built upon published follow-up exploring more examples of non-SOFIC groups, validating results and extending them rather than treating AI discoveries as terminal.
- As proving results becomes less of a bottleneck, the valued aspects of mathematics shift from primarily producing proofs to emphasizing understanding, communication, and maintenance of communal knowledge—making mathematical exposition and taste increasingly explicit and valuable.
- AI enables democratization of mathematics: people without full-time mathematics careers can now understand complex published results by using AI to explain proof strategies, whereas previously this required either personal expertise or access to experts.
- The model's proofs read surprisingly like human mathematician notes—disorganized in some ways like colleague emails sharing thoughts—rather than alien or incomprehensible logic, suggesting mathematical reasoning has recognizable structure across both human and AI cognition.
- One researcher reports it is much faster to input papers into AI models for proof strategy explanation than to read carefully, addressing the paradox that AI simultaneously creates an explosion of new mathematics and solves the absorption problem it creates.
Topics
Transcript
Often as a practicing mathematician, you have an idea, and then you kind of think it might work. Then you try for a few hours, a few weeks, and at some point you give up. Whereas for GPT, like, okay, a human told me to do this, like, let's just do this. And so that's why we're sort of in this renaissance of, like, reachable results. This is the best part about this problem, which is really nobody had any idea. It's the model just guessing in some insane way. It doesn't seem like there's a limit so far, but it doesn't have that context yet. It'd be nice for the world to find math on this one a lot…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The a16z Show
Can Open Source Keep AI Power From Concentrating?
Lucas Kaiser, co-author of the Transformer paper, discusses how AI power is currently concentrating in large companies due to the resource-intensive nature of current technology, but argues this is not inevitable. He believes research breakthroughs in algorithms and training methods could enable smaller players and distributed models to compete effectively.
Your AI Doctor Is Coming | Julie Yoo
Julie Yoo, a healthcare investor at Andreessen Horowitz, argues that AI will benefit healthcare more than any other industry because healthcare has historically underinvested in technology, allowing it to leapfrog legacy systems and adopt AI-native solutions directly. She identifies major opportunities in consumer healthcare, AI-native care delivery, robotics, and new payment models, predicting a future where individuals have personalized AI doctors available continuously.
Aaron Levie on Why Open AI Wins
Aaron Levie, CEO of Box, discusses why open-weight AI models benefit the entire AI ecosystem rather than threatening frontier labs, argues that the economic value in AI accrues to inference infrastructure rather than model weights, and explains why model routing will become the default enterprise AI strategy.
Fei Fei Li: The Race to Build World Models For AI
World Labs launched Atlas, a new world model built on next-view prediction that unifies 3D reconstruction and generation. The model can create spatially-grounded video frames from sparse input images (as few as three), reducing the data requirements for 3D scene capture by 50-100x, with applications ranging from creative content to robotics simulation.
The $100B Niches Hiding Inside Payments
Max Levchin and Alex Rampell discuss 25+ years of payments innovation, tracing PayPal's origins through their journey building Affirm. They explore how the credit card remains the best payment interface ever created, why there are no niches smaller than $100B in payments, and how AI may finally be ready to reinvent the payment experience itself.