Premium: Wave after wave of demand
NVIDIA is aggressively driving demand for AI compute through agentic AI software investments, ecosystem partnerships, and supply chain positioning. Major AI buildouts are scaling dramatically, with individual facilities projected to grow from 400-600MW this year to over 2GW by 2028-2029. Frontier AI labs like OpenAI and Anthropic are diversifying compute sources, while Google is pushing its TPU ecosystem into neoclouds.
Summary
The transcript covers NVIDIA's multi-pronged strategy to accelerate AI adoption and GPU demand, focusing on three main areas: agentic AI, ecosystem investments, and ongoing AI infrastructure buildouts.
On the agentic AI front, NVIDIA is providing open-source LLMs and new agentic software layers to drive enterprise adoption. The company is leveraging its existing CUDA-X libraries to accelerate data workloads for agents, which simultaneously increases GPU demand and offloads work from CPUs. The transcript argues that deeper agentic AI adoption will compound compute needs through long-running orchestration, spawned sub-agents, task-specific model calls, and accelerated data processing.
Regarding ecosystem investments, NVIDIA is using partnerships to secure upstream supply chain capacity while simultaneously seeding capacity for neoclouds, frontier AI labs, and sovereign AI initiatives. This dual-direction strategy helps NVIDIA maintain leverage across the value chain.
The AI buildout wave is described as coming from all directions simultaneously — hyperscalers, neoclouds, frontier AI labs, sovereign AI, and private capital funds. Individual AI campus scale is projected to grow dramatically, from 400-600MW housing 350-600K GPUs today, to over 2GW housing 3.5-4.5 million GPUs by 2028-2029. Management expects buildout costs to rise from $50-60B per gigawatt to $80-100B due to increasing density requirements.
On the competitive front, Anthropic is expanding beyond TPUs into GPUs, committing capacity from Azure, CoreWeave, and SpaceX. OpenAI is deepening its AWS relationship and will adopt Trainium for some agentic services but remains primarily GPU-focused. Google is aggressively expanding its TPU ecosystem and increasing capex, with Anthropic signing a new TPU deal and hints that OpenAI may also be involved.
Key Insights
- NVIDIA is using open-source LLMs and CUDA-X libraries not just as developer tools but as demand-generation mechanisms to increase GPU consumption across agentic workloads.
- The largest individual AI buildouts are projected to grow roughly 6-8x in GPU count by 2028-2029, from 350-600K GPUs to 3.5-4.5 million GPUs per facility, signaling a step-change in infrastructure scale.
- NVIDIA management expects per-gigawatt buildout costs to rise from $50-60B to $80-100B, attributing the increase to rising compute density rather than just inflation or supply constraints.
- Anthropic, historically associated with Google TPUs, is now committing to GPU capacity across Azure, CoreWeave, and SpaceX — representing a meaningful diversification of its compute strategy.
- Google is actively pushing its TPU ecosystem into neoclouds and has secured Anthropic as a customer in a new deal, with hints that OpenAI may also be drawn into the TPU ecosystem despite its GPU-first posture.
Topics
Full transcript available for MurmurCast members
Sign Up to Access