The problem with AI demand
The AI industry is facing a broken demand signal, where token usage is being inflated by unsustainable practices like employee leaderboard gaming, runaway agent costs, and flat-rate pricing models that don't reflect real compute costs. Anthropic is the only major AI lab visibly adjusting its pricing model to reflect actual usage economics. This raises serious questions about whether the massive AI infrastructure buildout is sized for real, sustainable demand.
Summary
The video argues that the AI industry's demand signal is fundamentally broken, with only Anthropic actively pricing its services to reflect what real consumption actually looks like. The CEO of Anthropic, speaking on the Dark Cast podcast, suggested that competitors don't fully understand the financial risks they're taking, implying they're building products based on excitement rather than rigorous economic modeling.
At the core of the problem is token consumption — the basic unit of AI usage. While simple chat interactions cost only a few hundred tokens, the new generation of autonomous AI agents can run for hours, burning through millions of tokens unattended. This has led to major companies like Uber blowing through their entire annual AI budget by April, and Goldman Sachs Research reporting that companies are overrunning their inference budgets by orders of magnitude, with AI costs on track to rival full engineering headcount.
A secondary problem is the 'token maxing' phenomenon, where companies like Meta and Shopify are incentivizing employees with leaderboards based on AI usage volume rather than productivity outcomes. Nvidia CEO Jensen Huang exemplified this mindset by suggesting a $500,000 engineer should be consuming at least $250,000 in tokens. Critics note that when usage — not output — is the metric, employees will simply game the system by burning tokens without productive purpose.
Anthropick's response to the unsustainable flat-rate pricing model has been to cut off third-party tools exploiting unlimited subscriptions and to move enterprise customers to per-token billing. One estimate suggested a single $200 Claude Max plan could be costing $2,000–$5,000 in actual compute. This pricing correction, while economically rational, risks triggering demand pullback from consumers and companies that budgeted for fixed costs.
The video concludes with a stark warning: the entire AI infrastructure investment cycle — data centers, chips, and networking — is predicated on the assumption that token demand will keep growing. If a significant portion of current usage is artificial (leaderboard gaming, looping agents, or unsustainable budget burns), then the infrastructure being built may be drastically oversized for the real, sustainable demand that will eventually emerge.
Key Insights
- Anthropic's CEO claims that competing AI companies don't truly understand the financial risks they're taking, suggesting they're building products because it 'sounds cool' rather than from disciplined economic analysis.
- Goldman Sachs Research found that companies are overrunning their initial AI inference budgets by orders of magnitude, with AI costs projected to rival full engineering headcount in 2024.
- Jensen Huang argued that a $500,000 engineer who does not consume at least $250,000 worth of tokens is cause for alarm — framing token consumption as a direct proxy for employee productivity and value.
- Anthropic found that a single $200 Claude Max unlimited subscription could be costing between $2,000 and $5,000 in actual compute, leading the company to cut off third-party tools exploiting the model and shift enterprises to per-token billing.
- The video argues that if a meaningful portion of current AI token demand is driven by leaderboard gaming, looping agents, or budgets companies can't sustain, then the massive infrastructure being built to serve that demand may be sized for an inflated number that won't hold.
Topics
Transcript
[0:00] The AI demand signal is broken and only one company is acting like it. >> I kind of get the impression that, you know, some of the other companies have not written down the spreadsheet that they don't really understand the risk they're taking. They're just kind of doing stuff cuz it sounds cool. >> That's the CEO of Anthropic on the Dark Cash podcast talking about the biggest spending cycle in tech history. His company, it's the only major AI lab pricing for what demand actually looks like. So, what's happening? Every time you use AI, it costs tokens. They're the basic unit of AI consumption. Every [0:32] question that you ask, every answer it gives back, every…
Full transcript available for MurmurCast members
Sign Up to AccessMore from CNBC
AI’s Next Race: Cost, Control, and Compute
The AI industry is entering a "postfrontier era" where success depends on orchestration, cost control, and open-weight models rather than frontier model capabilities alone. Perplexity CEO Arvin Hashemi and Benchmark's Peter Fenton predict that 90%+ of AI tokens could come from open-weight models within 18 months, driven by enterprise adoption, cost pressures, and performance benefits of specialized models tailored to specific tasks.
Why Ford is betting $5 billion on EVs
Ford is investing $5 billion in a new electric vehicle development center in Long Beach, California, with 350 engineers developing a universal EV platform. The first vehicle will be a mid-size electric pickup truck launching next year, positioned to compete against Tesla and Chinese EV manufacturers with unique features like RAV4-level interior space, a useful bed, and long-range capability.
How AI Super PACs Are Shaping The Midterms
AI-backed super PACs spent tens of millions during the midterms, with rival groups backed by OpenAI and Anthropic clashing over AI regulation policy. The competing PACs influenced congressional races, particularly one in New York where they opposed and supported different candidates based on their stance on AI regulation.
How Warsh's Task Forces Will Reshape The Federal Reserve
Fed Chair Kevin Warsh is establishing five task forces to reshape the Federal Reserve's approach to monetary policy, focusing on artificial intelligence's deflationary potential, modernizing inflation measurement beyond PCE, improving economic data collection, restructuring Fed communications, and reducing the central bank's balance sheet.
How Trump's $1.8B 'lawfare' fund works
The Justice Department created a $1.776 billion anti-weaponization fund to compensate people allegedly harmed by lawfare, established as part of a settlement where Trump and his family dropped a $10 billion lawsuit against the IRS over tax return leaks. The fund and an accompanying tax provision shielding Trump from IRS enforcement have generated bipartisan criticism and legal challenges, with Democrats concerned it could become a slush fund for Trump's political allies.