Why NVIDIA is 3 years ahead of everyone - NVIDIA CEO explains | Jensen Huang and Lex Fridman
Jensen Huang explains how NVIDIA stays 3 years ahead by anticipating AI innovation through internal research, industry collaboration, and maintaining flexible architecture like CUDA. He describes how they predicted the shift from LLM inference to agentic systems that use tools, leading to the design evolution from Grace Blackwell to Vera Rubin racks.
Summary
Jensen Huang outlines NVIDIA's strategy for staying ahead in AI hardware development, emphasizing the challenge of hardware cycles taking 3 years while AI model architectures change every 6 months. NVIDIA addresses this through three key approaches: conducting internal basic and applied research to gain hands-on experience, working with every AI company globally to understand industry challenges and trends, and maintaining CUDA's flexible architecture that balances specialization with adaptability. Huang provides concrete examples of successful prediction, such as anticipating mixture of experts architectures leading to MVLink 72 development, and the evolution from Grace Blackwell racks designed for LLM inference to Vera Rubin systems designed for agentic computing. He explains that predicting these shifts comes down to logical reasoning about what AI systems need to become useful digital workers - they must access files, conduct research, and use existing tools rather than reinventing everything. Using the analogy of a humanoid robot that would use a microwave rather than beam microwaves from its fingers, Huang argues that AI agents will naturally integrate with existing computing infrastructure, leading to what he calls a reinvention of the computer itself.
Key Insights
- NVIDIA maintains competitive advantage through three strategies: internal research for hands-on experience, collaboration with every AI company globally to understand industry challenges, and maintaining CUDA's flexible architecture that balances specialization with adaptability
- Hardware architectures evolve every 3 years while AI model architectures change every 6 months, requiring companies to anticipate what will happen 2-3 years in the future
- NVIDIA anticipated the shift from LLM inference to agentic systems, evolving from Grace Blackwell racks focused on processing LLMs to Vera Rubin racks with storage accelerators and new components designed for agents that use tools
- AI agents will function as digital workers that need to access ground truth through file systems, conduct research, and use existing tools rather than having everything built-in, because waiting for universally smart AI before making it useful is impractical
- The development of agentic AI systems that use existing tools and infrastructure represents a reinvention of the computer, with profound implications for the future of computing
Topics
Transcript
[0:03] multiplying AI, we could spin off agents as fast as you want to spin off agents. And so, you know, I you have four scaling laws. And and as we use the a agentic systems, they're going to create a lot more data. They're going to create a lot of experiences. Some of it we're going to say, "Wow, this is really good. We ought to memorize this." >> That data set then comes all the way back to pre-training. We memorize and generalize it. We then refine it and fine-tune it back into post training. [0:33] Then we enhance it even more with test time, you know, in the agent agents agentic systems, you know, put it onto…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Lessons from the Roman Empire for modern-day - historian explains | Anthony Kaldellis
Historian Anthony Kaldellis discusses lessons from the 2,200-year Roman Empire for modern America, focusing on the importance of building lasting institutions that serve the majority, aligning foreign policy rhetoric with actual military actions, and the persistent elements of human nature across centuries.
The enemies of the Roman Empire who almost destroyed it | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses how the Byzantine Empire survived multiple crises through cycles of decline and recovery, arguing that external threats rather than internal decay caused the 11th-century collapse, and emphasizing that historians should focus on the institutional structures and mechanisms that enabled long-term resilience rather than dramatic peak moments.
The last great war of the ancient world | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses the Byzantine-Persian War (602-628) as a devastating conflict that weakened both empires and enabled the rapid Arab conquests of the 630s-640s. He explains how the Byzantine Empire, under Emperor Heraclius, survived through military innovation like Greek fire and eventually stabilized by withdrawing to Asia Minor and reorganizing administratively.
Why the Roman Empire lasted so long | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis and Lex Fridman discuss why the Roman Empire remained stable and self-healing for so long, identifying two key factors: authorities' efforts to persuade subjects they were ruling on their behalf, and a unified Roman and Orthodox identity that made alternatives seem worse. They emphasize that both credible rhetoric and corresponding actions were essential to maintaining legitimacy and compliance.
Historian explains human nature | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis argues that despite significant cultural variations across history, fundamental aspects of human nature persist across time periods. He positions himself against postmodern relativism, asserting that while culture modifies human behavior, the basic parameters of human psychology—including love, hate, ambition, and competence—remain constant across societies and eras.