Jensen Huang hypes Lex to everyone
Jensen Huang demonstrates Nvidia's latest Grace Blackwell server technology to Lex Friedman at Computex, highlighting improvements in liquid cooling, assembly time, and CPU performance. Huang explains how the business model has shifted from selling CPU cores to generating and monetizing AI tokens.
Summary
Jensen Huang enthusiastically shows off Nvidia's Grace Blackwell server to Lex Friedman during what appears to be a Computex event. The key hardware improvements include achieving 100% liquid cooling (up from 80% in the last generation) and reducing assembly time from 2 hours to just 5 minutes. Huang emphasizes that ease of construction correlates with reliability. The Grace Blackwell CPU delivers 1.8x performance improvement over x86 processors. Huang explains a fundamental shift in the semiconductor economics: previous hyperscale CPUs were designed around a rental model where value was measured in dollars-per-core, incentivizing maximum core counts. In contrast, AI workloads don't rent cores but instead generate tokens that are monetized. This changes the optimization target entirely—the goal is now to complete the inference loop as quickly as possible and generate tokens at maximum speed. Huang humorously notes that this business model is straightforward: the more customers buy, the more profit they generate. The conversation includes lighthearted moments about Lex's presence at the event, discussion of a lengthy podcast Lex hosts, and casual remarks about food and cake at the conference.
Key Insights
- Jensen Huang argues that the shift from x86 CPU economics to AI workloads represents a fundamental business model change: hyperscale CPUs were optimized for rental with value measured in dollars-per-core, but AI economics optimize for token generation speed rather than core count.
- Huang claims that in the new AI paradigm, the core objective is to traverse the inference loop as quickly as possible and generate tokens at maximum speed, making speed-to-token-generation the primary performance metric rather than raw core availability.
- Grace Blackwell achieves 100% liquid cooling versus the previous 80% in the last generation Grace processor, and reduces assembly time from 2 hours to 5 minutes.
- Huang states that things which are easy to build are also reliable, connecting ease of manufacturing with system reliability.
- The Grace Blackwell CPU delivers 1.8x performance improvement over x86 hyperscale CPUs, addressing the new token-generation-focused workload requirements.
Topics
Transcript
[0:02] Good to meet you. >> Look at this guy. He went He's just traveling through Asia. >> Does everybody know the famous Lex Friedman? >> IT. STOP IT. >> DAD, say I love you. Look at this. Look at this. No cables, no hoses. 100% liquid cooled. >> Yes. >> Last generation Grace Blackwall was only 80% liquid cooled. Now it's 100% cooled. From 2 hours to assemble, it's now 5 [0:33] minutes. Things that are easy to build are also reliable. >> Officially in full production, right? >> Yeah, full production now. Incredible, right? >> That's incredible. >> All this, everything. >> And the various CPU, you're full in on the CPU. I saw the 1.8x over x86.…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Playing chess in prison vs serial killer | Larry Lawton and Lex Fridman
Larry Lawton describes witnessing an exceptionally skilled chess player in county jail who appeared to be a Russian murderer. The player demonstrated world-class ability by defeating multiple opponents simultaneously in just 10-13 moves while barely looking at the boards, prompting discussion about how elite chess players can visualize entire games mentally.
GTA 6 review by biggest jewelry thief in US history | Larry Lawton and Lex Fridman
Larry Lawton, a legendary jewelry thief and FBI's most-wanted criminal, discusses his extensive experience robbing stores while reviewing GTA 6's trailer with Lex Fridman. He provides detailed critiques of the game's accuracy regarding criminal operations, casing techniques, and security vulnerabilities, while reflecting on how his past crimes cost him years with his children.
Robberies in GTA 6 - jewelry thief explains | Larry Lawton and Lex Fridman
Larry Lawton, a former jewelry thief, discusses his criminal expertise with Lex Fridman and explains what he wants to see portrayed accurately in GTA 6's robbery mechanics. He emphasizes that successful robberies depend heavily on meticulous casing and understanding human behavior patterns rather than just technology.
US war against China or Russia: Why military experts are wrong | Lex Fridman Podcast
Military analysts often make prediction errors by abstracting military power as a simple ranking rather than understanding how forces interact in specific contexts. The Ukraine-Russia war exemplified this, as analysts underestimated Ukrainian military capability and overestimated Russian performance, partly due to having more intelligence on Russian plans than Ukrainian defenses.
Is Putin being lied to? - The distortion of information in Ukraine war | Military Analysis
The transcript discusses how Russian military forces systematically overstate territorial control through false reporting, creating a cascading problem where fabricated battlefield data leads to poor operational decisions, increased casualties, and potentially misinforms political leadership including Putin. The speakers contrast this with Ukrainian practices and explore broader patterns of information distortion in military hierarchies across historical conflicts.