How Nvidia Actually Allocates GPUs - Jensen Huang
Jensen Huang clarifies that Larry Ellison and Elon Musk never begged for GPUs at their dinner, and explains Nvidia's GPU allocation strategy. Nvidia uses a first-in-first-out system rather than selling to highest bidders, prioritizing dependability and consistent pricing to serve as a reliable foundation for the industry.
Summary
Jensen Huang addresses misconceptions about a widely reported dinner with Larry Ellison and Elon Musk, clarifying that while they did have dinner, the tech leaders never begged for GPUs as reported in media coverage. Instead, they simply needed to place orders like any other customer. Huang explains Nvidia's systematic approach to GPU allocation, which begins with working closely with customers to develop accurate forecasts since both GPU manufacturing and data center construction require significant lead times. The company prioritizes customers who are prepared and ready to receive shipments, as serving unprepared customers would reduce overall factory throughput efficiency. Beyond readiness considerations, Nvidia follows a straightforward first-in-first-out allocation system. Huang explicitly rejects auction-style pricing to the highest bidder, viewing this as poor business practice that would undermine Nvidia's role as a dependable industry foundation. The company maintains consistent pricing regardless of demand fluctuations, emphasizing reliability and predictability over short-term profit maximization.
Key Insights
- Jensen Huang states that Larry Ellison and Elon Musk never actually begged for GPUs during their dinner together, contrary to media reports
- Nvidia prioritizes customers who are prepared and ready to receive GPU shipments because serving unprepared customers reduces overall factory throughput
- Nvidia uses a first-in-first-out allocation system rather than complex prioritization schemes for GPU distribution
- Jensen Huang considers selling GPUs to the highest bidder a bad business practice that undermines dependability
- Nvidia maintains fixed pricing regardless of demand levels, positioning itself as a reliable foundation for the industry
Topics
Transcript
[0:00] It was a article about Larry and Elon having dinner with me where they begged for GPUs. That never happened. We absolutely had dinner. It was a wonderful dinner. In no time did they beg for GPUs. They just had to place an order. And once they place an order, we do our best to get the capacity to them. The first thing is we work really hard with everybody to get a forecast done because these things take a long time to build and the data centers take a long time to build. If you're not ready, we might decide to serve another customer first. That's just maximizing the throughput of our own factory. Aside from that, the…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Dwarkesh Patel
China's Belt and Road Problem - Sarah Paine
Sarah Paine argues that China's Belt and Road Initiative is strategically flawed, citing the economic and security superiority of maritime shipping over land-based routes and China's vulnerability to naval blockade in wartime due to its geographical position surrounded by shallow seas and islands.
Einstein's happiest thought: General Relativity from scratch – Adam Brown
Adam Brown explains Einstein's general relativity from first principles, starting with the equivalence principle and how gravity curves spacetime. He demonstrates why black holes exist as inevitable consequences of general relativity and discusses how falling into a black hole feels different depending on your reference frame.
The Real Effects of the Six Day War - Sarah Paine
Sarah Paine explains how Egypt's closure of the Suez Canal during the Six Day War had unexpected strategic consequences that reshaped global shipping. The blockade forced the development of much larger cargo ships that could not fit through the canal, fundamentally altering maritime economics in ways that persisted long after the canal reopened.
The Dutch-American who saw America's blind spot clearly - Sarah Paine
Sarah Paine discusses Nicholas Spikeman, a Dutch-American geopolitical thinker who warned in 1943 that control of Eurasia could determine global dominance. Spikeman critiqued American statesmen for consistently miscalculating outcomes and failing to develop effective national security strategies, despite the US occupying an advantageous geographic position.
How Geography Shapes Empire - Sarah Paine
Sarah Paine traces the origins of maritime empires back to Athens, contrasting sea-based empires like Rome with land-based empires like Russia and China. She illustrates how geographical terminology reflects fundamentally different imperial orientations: Mediterranean empires centered on the sea as a connecting medium, while Chinese civilization emphasized land-based central authority.