The problem with AI demand
The AI industry is facing a broken demand signal, where token usage is being inflated by unsustainable practices like employee leaderboard gaming, runaway agent costs, and flat-rate pricing models that don't reflect real compute costs. Anthropic is the only major AI lab visibly adjusting its pricing model to reflect actual usage economics. This raises serious questions about whether the massive AI infrastructure buildout is sized for real, sustainable demand.
Summary
The video argues that the AI industry's demand signal is fundamentally broken, with only Anthropic actively pricing its services to reflect what real consumption actually looks like. The CEO of Anthropic, speaking on the Dark Cast podcast, suggested that competitors don't fully understand the financial risks they're taking, implying they're building products based on excitement rather than rigorous economic modeling.
At the core of the problem is token consumption — the basic unit of AI usage. While simple chat interactions cost only a few hundred tokens, the new generation of autonomous AI agents can run for hours, burning through millions of tokens unattended. This has led to major companies like Uber blowing through their entire annual AI budget by April, and Goldman Sachs Research reporting that companies are overrunning their inference budgets by orders of magnitude, with AI costs on track to rival full engineering headcount.
A secondary problem is the 'token maxing' phenomenon, where companies like Meta and Shopify are incentivizing employees with leaderboards based on AI usage volume rather than productivity outcomes. Nvidia CEO Jensen Huang exemplified this mindset by suggesting a $500,000 engineer should be consuming at least $250,000 in tokens. Critics note that when usage — not output — is the metric, employees will simply game the system by burning tokens without productive purpose.
Anthropick's response to the unsustainable flat-rate pricing model has been to cut off third-party tools exploiting unlimited subscriptions and to move enterprise customers to per-token billing. One estimate suggested a single $200 Claude Max plan could be costing $2,000–$5,000 in actual compute. This pricing correction, while economically rational, risks triggering demand pullback from consumers and companies that budgeted for fixed costs.
The video concludes with a stark warning: the entire AI infrastructure investment cycle — data centers, chips, and networking — is predicated on the assumption that token demand will keep growing. If a significant portion of current usage is artificial (leaderboard gaming, looping agents, or unsustainable budget burns), then the infrastructure being built may be drastically oversized for the real, sustainable demand that will eventually emerge.
Key Insights
- Anthropic's CEO claims that competing AI companies don't truly understand the financial risks they're taking, suggesting they're building products because it 'sounds cool' rather than from disciplined economic analysis.
- Goldman Sachs Research found that companies are overrunning their initial AI inference budgets by orders of magnitude, with AI costs projected to rival full engineering headcount in 2024.
- Jensen Huang argued that a $500,000 engineer who does not consume at least $250,000 worth of tokens is cause for alarm — framing token consumption as a direct proxy for employee productivity and value.
- Anthropic found that a single $200 Claude Max unlimited subscription could be costing between $2,000 and $5,000 in actual compute, leading the company to cut off third-party tools exploiting the model and shift enterprises to per-token billing.
- The video argues that if a meaningful portion of current AI token demand is driven by leaderboard gaming, looping agents, or budgets companies can't sustain, then the massive infrastructure being built to serve that demand may be sized for an inflated number that won't hold.
Topics
Transcript
[0:00] The AI demand signal is broken and only one company is acting like it. >> I kind of get the impression that, you know, some of the other companies have not written down the spreadsheet that they don't really understand the risk they're taking. They're just kind of doing stuff cuz it sounds cool. >> That's the CEO of Anthropic on the Dark Cash podcast talking about the biggest spending cycle in tech history. His company, it's the only major AI lab pricing for what demand actually looks like. So, what's happening? Every time you use AI, it costs tokens. They're the basic unit of AI consumption. Every [0:32] question that you ask, every answer it gives back, every…
Full transcript available for MurmurCast members
Sign Up to AccessMore from CNBC
Watch AI Dock A Boat
CNBC's Contessa Brewer demonstrates a 36-foot Cray boat equipped with advanced marine technology, including GPS, radar, and newly launched autonomous docking capabilities. The boat's base price is $550,000, with fully equipped models featuring autopilot and autonomous docking reaching $880,000.
What Will TV Look Like In 3 Years?
Industry leaders predict that TV will continue its shift toward streaming and live content over the next three years, with cable subscribers declining further and AI enabling personalized, multilingual viewing experiences. Sports remain a critical driver of viewership as one of the few irreplaceable live experiences, while new aggregator services and platforms like Tubi and Roku Channel are expected to gain significant market share.
To keep growing, Best Buy wants to go smaller
Best Buy is launching small and medium-format stores this summer as part of a strategic pivot following years of declining sales and stock performance post-COVID. New CEO Jason Bonfig will take over from Corie Barry in October and plans to accelerate growth through this revised store strategy while capitalizing on the AI boom.
How Audi hopes to win back consumers
Audi is attempting to regain market competitiveness by launching three new premium SUVs, including the Q9 and SQ9, featuring advanced technologies like smart headlights and OLED lighting. The brand has struggled since 2020, falling behind BMW and Mercedes-Benz in quality rankings and market share, with recent losses attributed to tariffs and the end of federal EV subsidies.
Inside SK Hynix: We Went To Korea To See The World's Biggest AI Memory Buildout
SK Hynix, South Korea's memory chip giant, is undertaking a historic $720 billion expansion to triple HBM (high-bandwidth memory) capacity by 2034, driven by unprecedented AI demand. The company is building massive new facilities in Korea while establishing its first U.S. packaging fab in Indiana, though it faces traditional boom-bust cycle risks and competition from Samsung, Micron, and Chinese manufacturers.