DiscussionOpinion

Aaron Levie on Why Open AI Wins

The a16z Show31m 5s

Aaron Levie, CEO of Box, discusses why open-weight AI models benefit the entire AI ecosystem rather than threatening frontier labs, argues that the economic value in AI accrues to inference infrastructure rather than model weights, and explains why model routing will become the default enterprise AI strategy.

Summary

Aaron Levie joins the conversation to discuss the recent open-weights letter signed by Jensen Huang and Box. He frames open-weight AI not as zero-sum competition with closed models, but as complementary innovation that drives overall AI progress and creates more use cases. Levie argues that the letter has two main points: open-weight models are crucial for AI innovation and diffusion, and the U.S. should invest more heavily in open-weight development rather than rely on Chinese models.

On the contentious topic of distillation, Levie takes a permissive stance, arguing it's difficult to establish ethical or legal distinctions between training models on public internet data versus training on AI model outputs. He contends that if models are trained on broadly available knowledge, there's no clear line that makes distillation illegitimate. However, he acknowledges that if he ran a frontier lab, he would attempt to prevent distillation through defensive mechanisms.

Addressing national security concerns about Chinese open-weight models, Levie argues that attempting to restrict China's AI development is futile and counterproductive. He emphasizes that China has the talent, resources, and strategic motivation to develop AI regardless of U.S. restrictions. The alternative scenario—forcing China to develop on different hardware stacks—could actually accelerate their independence and capability rather than slow their progress.

On the economics of open versus closed models, Levie contends that the true moneymaker in AI is inference, not model weights. As competition increases among frontier labs, token costs will converge toward infrastructure costs, making the traditional margins from closed models less defensible. He argues that even open-weight releases wouldn't significantly harm closed labs' revenue if they control the preferred inference infrastructure or post-training environments.

Regarding why frontier labs haven't embraced open-sourcing more aggressively, Levie identifies two categories of reasoning: those with longer time horizons may see open-source as economically viable long-term, while labs like Anthropic likely view it as a safety issue, believing centralized control is necessary for responsible AI deployment.

Levie discusses Anthropic's new Claude Opus 5 model positively, noting meaningful improvements over Opus 4.8 across general knowledge work and domain-specific tasks relevant to Box's enterprise customers. He identifies a problem with Claude's current approach where certain capabilities trigger safety measures and downgrade to weaker models, which he argues is untenable for the future of AI adoption.

On the impact of AI at Box, Levie reports that AI has not reduced hiring but expanded the engineering roadmap dramatically. Projects previously deemed too complex or too small to tackle are now feasible, allowing the company to be more ambitious while also maintaining human engineering talent. He emphasizes that the constraint is now financial rather than technical.

Final discussion centers on model routing as the emerging enterprise strategy, with Levie arguing that as models continuously improve and leapfrog each other, enterprises benefit from abstraction layers that enable model switching without lock-in. This applied AI layer creates value by handling workflow integration, data management, and vertical-specific implementation that pure horizontal models cannot.

About this episode

Box co-founder and CEO Aaron Levie joins MTS hosts Theo Jaffee and Sofia Puccini to make the case for open-weight AI, unpack the economics of open versus closed models, and explain why he believes more openness could strengthen rather than undermine the U.S. AI ecosystem. Aaron argues that open models create more use cases, push closed labs to innovate faster, and don't fundamentally change where the economics of AI ultimately accrue. They debate model distillation, America's competition with China, why restricting access may simply accelerate competing AI ecosystems, and whether U.S. labs should begin releasing open-weight versions of previous-generation models. They also get into what the latest frontier models mean for knowledge work, how AI has changed software engineering at Box, and why Aaron believes companies cutting engineers may simply not be ambitious enough. Finally, they discuss why enterprises are unlikely to bet on a single model and why the layer that routes between models, data, and workflows could become increasingly valuable.

Key Insights

  • Levie argues that open-weight AI is not zero-sum with closed models but rather adds to the ecosystem's total innovation capacity and creates new use cases that wouldn't exist otherwise.
  • Levie contends that the fundamental economic value in AI accrues to inference infrastructure costs rather than proprietary model weights, meaning token prices will converge toward infrastructure costs as competition increases among multiple frontier labs.
  • Levie claims there is no credible ethical or legal distinction between training models on public internet data and training models on the outputs of other AI models, making distillation restrictions difficult to enforce or justify.
  • Levie argues that attempting to restrict China's AI development through export controls or open-source limitations is futile because China possesses the talent, resources, and strategic motivation to develop AI independently regardless of U.S. policies.
  • Levie suggests that frontier labs like Anthropic likely resist open-sourcing models primarily due to safety and control concerns rather than economic concerns, believing centralized token flow is necessary for responsible deployment.
  • Levie reports that at Box, AI has expanded rather than contracted the product roadmap, enabling the company to tackle multi-year projects that were previously deemed infeasible while simultaneously hiring more engineers to pursue increased ambition.
  • Levie identifies a significant problem with Claude's current architecture where safety guardrails cause the model to downgrade to weaker versions of itself for certain queries, creating user experience issues he argues are unsustainable for AI adoption at scale.
  • Levie predicts that model routing layers will become increasingly valuable in enterprise AI because they reduce analysis paralysis around model selection and enable workflows to flexibly use different frontier models as they continuously improve without requiring costly migrations.

Topics

Open-weight AI models and ecosystem impactDistillation and intellectual property in AIU.S.-China AI competition and national securityAI model economics and inference infrastructureFrontier lab business models and open-sourcing strategiesClaude Opus 5 performance evaluationAI's impact on software engineering and product roadmapsModel routing and enterprise AI strategy

Transcript

Open-weight AI is often framed as a threat to frontier labs. Aaron Levy thinks that gets the economics backwards. The Box co-founder and CEO joins Theo Jaffe and Sofia Puccini on MTS to discuss why open models could make the AI ecosystem more competitive, the debate around distillation in China, and why America needs more open-weight AI. They also get into the latest frontier models, how AI is expanding rather than shrinking Box's engineering roadmap, and why model routing could become the default for enterprise AI. We are live with Aaron Levy, the co-founder and CEO of Box, which does all kinds of things, cloud content management, enterprise documents, permissions, collaboration, a lot of different AI functions. He has an…

Full transcript available for MurmurCast members

Sign Up to Access

More from The a16z Show

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.