DiscussionOpinion

20VC: Are OpenAI and Anthropic Overvalued? The Open-Source AI Reality | How Token Costs Will Fall 10x And Usage Will Explode 100x | The Future Is Not One AGI; It's Millions of Specialised Models with Lin Qiao, Founder and CEO @ Fireworks

Lin Qiao, CEO of Fireworks, discusses how specialized AI models will dominate over single AGI systems, predicting 10x token cost reductions and 100x usage increases over three years. He argues that companies should own their own customized intelligence rather than relying on frontier models, positioning Fireworks as the infrastructure layer enabling this shift.

Summary

Lin Qiao founded Fireworks at age 48 after spending seven years at Facebook learning how to build companies at scale. The company has scaled to $800 million in ARR in four years by focusing on inference optimization and specialized model deployment rather than training general models.

Qiao's central thesis challenges the AGI narrative promoted by OpenAI and Anthropic. He argues that the future belongs to millions of specialized models tailored to specific use cases, not one dominant general intelligence. This belief stems from his observation that 90% of world data is private and locked within enterprises—data that cannot be used to train public models but could drive tremendous value if activated through specialized intelligence.

On the open source question, Qiao explains why Fireworks bet on open models early despite their infancy. Open models provide users full control over weights, enabling customization with proprietary data. While frontier models and open models have both crossed quality thresholds, open models are easier to tune with small amounts of unique company data. He notes that Fireworks processes 40 trillion tokens daily, mostly from customized models, not off-the-shelf ones.

Qiao predicts a fundamental shift in enterprise AI adoption. During the SaaS era, product-market fit and durable business were equivalent. Now they're separate—many startups achieve PMF but cannot scale profitably because inference costs would bankrupt them. This creates demand for alternatives: either companies must use cheaper open models they can customize, or frontier labs must drastically reduce prices. The cost reduction Qiao predicts (10x in three years) will drive 100x usage expansion.

On whether frontier model companies are overvalued, Qiao likens them to power lines distributing intelligence infrastructure rather than replacements for everything companies do. He views Anthropic's enterprise strategy as validation that specialized intelligence matters, but notes Anthropic's AGI belief means they see no need for specialization—a fundamental philosophical difference.

Regarding Fireworks' positioning between chips and applications, Qiao emphasizes the company specializes in what it adds most value to: the customization and optimization layer. The company achieves 30-40% gross margins during hypergrowth because it prioritizes innovation velocity over margin optimization. They deliberately avoid the application layer but could eventually move into data centers if timing makes sense.

On the data center and chip questions, Qiao explains that chip building makes sense only after workloads stabilize. The AI industry's workloads remain too dynamic to justify custom silicon—hardware launches every year with three SKUs, models launch weekly, and depreciation cycles are mismatched. This cascading funnel of stability works downward: once application workloads mature, then infrastructure patterns, then data center design, then chips.

Qiao hired George Hu, former Salesforce president, after initially telling him Fireworks was too small. Only after the company grew to 200 people and achieved very high growth rates did the timing feel right. Qiao emphasizes hiring people with extreme ownership mentality who claim end-to-end problems rather than waiting for delegation.

On national security and sovereign models, Qiao believes every country should own their own power line of intelligence, similar to electricity infrastructure. He sees this not as protectionism but as essential independence—companies and nations shouldn't risk being cut off by a single provider.

Qiao's prediction for the next three years: every company will own their own intelligence as a must-have, not optional. This mirrors how every company owns its software stack, picking which parts to build versus which to use from common infrastructure. The difference will be that while some use frontier models, most will customize open models for competitive advantage and cost efficiency.

About this episode

<p dir="ltr">Lin Qiao is the Co-Founder and CEO of Fireworks AI, the leading specialized intelligence and AI inference platform that last week raised $1.5BN at a whopping $17BN valuation. With just 200 people, the company has hit $1BN in ARR and expects to hit $2BN before the end of the year. Prior to Fireworks, Lin spent several years at Meta including on the founding team of PyTorch. </p> <p dir="ltr"><span style="text-decoration: underline;"><strong>AGENDA:</strong></span></p> <p dir="ltr">00:07 — Why Did Fireworks Bet on Inference When Everyone Else Was Chasing Training?</p> <p dir="ltr">00:13 — Can Open-Source Models Turn AI Infrastructure into a Commodity?</p> <p dir="ltr">00:19 — Should Enterprises Trust Chinese Open Models With Their Most Sensitive Data?</p> <p dir="ltr">00:25 — Will Model Progress Keep Moving This Fast—or Are We Nearing a Plateau?</p> <p dir="ltr">00:28 — Will the Multi-Model World Create a $100BN Routing Layer?</p> <p dir="ltr">00:37 — How Much Will AI Token Usage Explode Over the Next Two Years?</p> <p dir="ltr">00:43 — Will Token Costs Fall 10x—and Unleash 100x More Demand?</p> <p dir="ltr">00:49 — Does Fireworks Eventually Have to Build Its Own Data Centres?</p> <p dir="ltr">01:02 — What Is the Real Bottleneck Holding Back the AI Economy?</p> <p> </p>

Key Insights

  • Qiao argues that 90% of world data is private and locked inside enterprises, making it unavailable for training general models but potentially valuable through specialized intelligence customization
  • He claims that during the SaaS era, achieving product-market fit guaranteed scalable business, but in AI, many companies with PMF cannot scale profitably because inference costs would bankrupt them
  • Qiao predicts token costs will fall 10x in the next three years due to competitive market forces and infrastructure improvements, driving 100x usage expansion
  • He asserts that frontier model companies like OpenAI and Anthropic function as power line infrastructure distributing intelligence, not as replacements for specialized company-specific models
  • Qiao argues that open models crossed a quality threshold where they can solve diverse problems and are easier to customize with proprietary data than frontier models
  • He states that Fireworks deliberately avoids the application layer because the company specializes in customization and optimization where it adds most value
  • Qiao believes chip building only makes economic sense after workloads stabilize, and current AI workloads are too dynamic (with weekly model launches and annual hardware refreshes) to justify custom silicon
  • He claims that every company should own their own intelligence as a must-have (not optional), mirroring how every company owns its software stack
  • Qiao argues that the speed of company revenue growth in AI is unprecedented because the technology is fundamentally empowering to human creativity across all individuals
  • He contends that product quality in his market requires bit-equivalent accuracy between training and inference systems, preventing commoditization and justifying premium pricing
  • Qiao states that without control over models, companies cannot optimize costs, making open source adoption inevitable for enterprises at scale
  • He argues that operational excellence in leadership during high-velocity periods requires detailed knowledge of ground-level information to make precise judgments, not relying on cascading information through layers

Topics

Specialized vs. General AI ModelsOpen Source vs. Frontier ModelsEnterprise AI Adoption and EconomicsInference Optimization and DeploymentToken Cost Reduction PredictionsPrivate Data and Intelligence CustomizationInfrastructure Layer PositioningData Centers and Chip DesignNational Sovereignty in AICompany Growth and ScalingVenture Capital and Business ModelsTechnical System Design

Transcript

What I don't want to see is there's only one company owns intelligence. I think that doesn't make sense to me. I think last year is the year of coding, and this year is the year of co-work. I do think the cost of token will go down drastically, 10x cost reduction in the next three years. And this 10x cost reduction will drive 100x usage. We absolutely are not going to move into application layer. Very clear to us. Whether we will move down into view data centers and so on, that could always be on the table. This is 20VC with me, Harry Stebbings. And in the hot seat today, a founder who I wrote a $10 million…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.