Aaron Levie on Why Open AI Wins
Aaron Levie, CEO of Box, discusses why open-weight AI models benefit the entire AI ecosystem rather than threatening frontier labs, argues that the economic value in AI accrues to inference infrastructure rather than model weights, and explains why model routing will become the default enterprise AI strategy.
Summary
Aaron Levie joins the conversation to discuss the recent open-weights letter signed by Jensen Huang and Box. He frames open-weight AI not as zero-sum competition with closed models, but as complementary innovation that drives overall AI progress and creates more use cases. Levie argues that the letter has two main points: open-weight models are crucial for AI innovation and diffusion, and the U.S. should invest more heavily in open-weight development rather than rely on Chinese models.
On the contentious topic of distillation, Levie takes a permissive stance, arguing it's difficult to establish ethical or legal distinctions between training models on public internet data versus training on AI model outputs. He contends that if models are trained on broadly available knowledge, there's no clear line that makes distillation illegitimate. However, he acknowledges that if he ran a frontier lab, he would attempt to prevent distillation through defensive mechanisms.
Addressing national security concerns about Chinese open-weight models, Levie argues that attempting to restrict China's AI development is futile and counterproductive. He emphasizes that China has the talent, resources, and strategic motivation to develop AI regardless of U.S. restrictions. The alternative scenario—forcing China to develop on different hardware stacks—could actually accelerate their independence and capability rather than slow their progress.
On the economics of open versus closed models, Levie contends that the true moneymaker in AI is inference, not model weights. As competition increases among frontier labs, token costs will converge toward infrastructure costs, making the traditional margins from closed models less defensible. He argues that even open-weight releases wouldn't significantly harm closed labs' revenue if they control the preferred inference infrastructure or post-training environments.
Regarding why frontier labs haven't embraced open-sourcing more aggressively, Levie identifies two categories of reasoning: those with longer time horizons may see open-source as economically viable long-term, while labs like Anthropic likely view it as a safety issue, believing centralized control is necessary for responsible AI deployment.
Levie discusses Anthropic's new Claude Opus 5 model positively, noting meaningful improvements over Opus 4.8 across general knowledge work and domain-specific tasks relevant to Box's enterprise customers. He identifies a problem with Claude's current approach where certain capabilities trigger safety measures and downgrade to weaker models, which he argues is untenable for the future of AI adoption.
On the impact of AI at Box, Levie reports that AI has not reduced hiring but expanded the engineering roadmap dramatically. Projects previously deemed too complex or too small to tackle are now feasible, allowing the company to be more ambitious while also maintaining human engineering talent. He emphasizes that the constraint is now financial rather than technical.
Final discussion centers on model routing as the emerging enterprise strategy, with Levie arguing that as models continuously improve and leapfrog each other, enterprises benefit from abstraction layers that enable model switching without lock-in. This applied AI layer creates value by handling workflow integration, data management, and vertical-specific implementation that pure horizontal models cannot.
About this episode
Box co-founder and CEO Aaron Levie joins MTS hosts Theo Jaffee and Sofia Puccini to make the case for open-weight AI, unpack the economics of open versus closed models, and explain why he believes more openness could strengthen rather than undermine the U.S. AI ecosystem. Aaron argues that open models create more use cases, push closed labs to innovate faster, and don't fundamentally change where the economics of AI ultimately accrue. They debate model distillation, America's competition with China, why restricting access may simply accelerate competing AI ecosystems, and whether U.S. labs should begin releasing open-weight versions of previous-generation models. They also get into what the latest frontier models mean for knowledge work, how AI has changed software engineering at Box, and why Aaron believes companies cutting engineers may simply not be ambitious enough. Finally, they discuss why enterprises are unlikely to bet on a single model and why the layer that routes between models, data, and workflows could become increasingly valuable.
Key Insights
- Levie argues that open-weight AI is not zero-sum with closed models but rather adds to the ecosystem's total innovation capacity and creates new use cases that wouldn't exist otherwise.
- Levie contends that the fundamental economic value in AI accrues to inference infrastructure costs rather than proprietary model weights, meaning token prices will converge toward infrastructure costs as competition increases among multiple frontier labs.
- Levie claims there is no credible ethical or legal distinction between training models on public internet data and training models on the outputs of other AI models, making distillation restrictions difficult to enforce or justify.
- Levie argues that attempting to restrict China's AI development through export controls or open-source limitations is futile because China possesses the talent, resources, and strategic motivation to develop AI independently regardless of U.S. policies.
- Levie suggests that frontier labs like Anthropic likely resist open-sourcing models primarily due to safety and control concerns rather than economic concerns, believing centralized token flow is necessary for responsible deployment.
- Levie reports that at Box, AI has expanded rather than contracted the product roadmap, enabling the company to tackle multi-year projects that were previously deemed infeasible while simultaneously hiring more engineers to pursue increased ambition.
- Levie identifies a significant problem with Claude's current architecture where safety guardrails cause the model to downgrade to weaker versions of itself for certain queries, creating user experience issues he argues are unsustainable for AI adoption at scale.
- Levie predicts that model routing layers will become increasingly valuable in enterprise AI because they reduce analysis paralysis around model selection and enable workflows to flexibly use different frontier models as they continuously improve without requiring costly migrations.
Topics
Transcript
Open-weight AI is often framed as a threat to frontier labs. Aaron Levy thinks that gets the economics backwards. The Box co-founder and CEO joins Theo Jaffe and Sofia Puccini on MTS to discuss why open models could make the AI ecosystem more competitive, the debate around distillation in China, and why America needs more open-weight AI. They also get into the latest frontier models, how AI is expanding rather than shrinking Box's engineering roadmap, and why model routing could become the default for enterprise AI. We are live with Aaron Levy, the co-founder and CEO of Box, which does all kinds of things, cloud content management, enterprise documents, permissions, collaboration, a lot of different AI functions. He has an…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The a16z Show
Fei Fei Li: The Race to Build World Models For AI
World Labs launched Atlas, a new world model built on next-view prediction that unifies 3D reconstruction and generation. The model can create spatially-grounded video frames from sparse input images (as few as three), reducing the data requirements for 3D scene capture by 50-100x, with applications ranging from creative content to robotics simulation.
The $100B Niches Hiding Inside Payments
Max Levchin and Alex Rampell discuss 25+ years of payments innovation, tracing PayPal's origins through their journey building Affirm. They explore how the credit card remains the best payment interface ever created, why there are no niches smaller than $100B in payments, and how AI may finally be ready to reinvent the payment experience itself.
Inside Moderna’s Personalized Cancer Vaccine
Moderna and Merck announced positive Phase 3 results for an individualized mRNA cancer vaccine (Intesmiran) for melanoma, achieving 80% disease-free survival at five years compared to 60% with Keytruda alone. The breakthrough combines mRNA technology with personalization, sequencing each patient's tumor to identify mutations and create a patient-specific vaccine that teaches the immune system to recognize cancer cells.
Daniel Litt: The Mathematician's Guide to AI
Daniel Litt, a mathematician at University of Toronto, discusses AI's evolving capabilities in mathematics, distinguishing between what models can do well (applying known techniques, solving specific problems) versus where they fall short (developing intuition, building new theories, asking fundamental questions). He emphasizes that while AI results are impressive, the mathematics community must adapt its incentive structures to preserve human understanding and maintain cognitive diversity in mathematical research.
Gavin Baker: Why AI Demand Is Outrunning Compute Supply
Gavin Baker and David George discuss why AI demand is outrunning compute supply, examining the positive-sum nature of the AI market where frontier labs, open-source models, cloud providers, and chip companies can all win. They argue that despite concerns about bubbles, the economics of AI infrastructure show sub-one-year paybacks, massive supply constraints, and early adoption suggesting we're nowhere near peak demand.