No 1-on-1 meetings: How Jensen Huang runs NVIDIA | Lex Fridman Podcast Clips
Jensen Huang explains NVIDIA's extreme co-design approach, where they optimize across the entire technology stack from software to hardware to systems. He manages 60 direct reports without one-on-one meetings, instead using group discussions where all experts collaborate on problems since every component affects others.
Summary
Jensen Huang describes NVIDIA's unique approach to building complex AI systems through what he calls 'extreme co-design.' This involves optimizing across multiple layers simultaneously: software architectures, chips, systems, system software, algorithms, and applications. The challenge extends beyond just CPUs and GPUs to include networking chips, switches, power delivery, and cooling systems, all of which must work together efficiently in power-hungry AI systems. Huang emphasizes that company organization should reflect the product being built, criticizing the standard 'hamburger' organizational charts used by most companies regardless of their output. His management structure reflects this philosophy - he has 60 direct reports, mostly with engineering backgrounds, who are experts in different areas like memory, CPUs, optics, GPUs, and algorithms. Rather than conducting one-on-one meetings, which would be logistically impossible, he uses group problem-solving sessions where all relevant experts participate. This approach works because when discussing any component (like cooling or networking), other team members can immediately identify conflicts or dependencies with their areas (power distribution, memory, etc.). Team members are expected to know when to contribute and are held accountable if they miss opportunities to provide valuable input. This collaborative approach enables the extreme co-design that NVIDIA requires to build integrated AI systems.
About this episode
Lex Fridman Podcast full episode: https://www.youtube.com/watch?v=vif8NQcjVf0 Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/cv9756-sb See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc. *GUEST BIO:* Jensen Huang is the co-founder and CEO of NVIDIA, the world's most valuable company and the engine powering the AI computing revolution. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *EPISODE LINKS:* NVIDIA: https://nvidia.com NVIDIA on X: https://x.com/nvidia NVIDIA AI on X: https://x.com/NVIDIAAI NVIDIA on YouTube: https://youtube.com/@NVIDIA NVIDIA on Instagram: https://www.instagram.com/nvidia/ NVIDIA on LinkedIn: https://www.linkedin.com/company/nvidia/ NVIDIA on Facebook: https://www.facebook.com/NVIDIA/ NVIDIA on GitHub: https://github.com/NVIDIA Nemotron: https://developer.nvidia.com/nemotron *SPONSORS:* To support this podcast, check out our sponsors & get discounts: *Perplexity:* AI-powered answer engine. Go to https://lexfridman.com/s/perplexity-cv9756-sb *Shopify:* Sell stuff online. Go to https://lexfridman.com/s/shopify-cv9756-sb *LMNT:* Zero-sugar electrolyte drink mix. Go to https://lexfridman.com/s/lmnt-cv9756-sb *Fin:* AI agent for customer service. Go to https://lexfridman.com/s/fin-cv9756-sb *Quo:* Phone system (calls, texts, contacts) for businesses. Go to https://lexfridman.com/s/quo-cv9756-sb *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman
Key Insights
- Replace one-on-one meetings with group problem-solving sessions when building complex integrated products, as experts in different components can immediately identify cross-functional conflicts and dependencies
- Design your company's organizational structure to mirror the architecture of the product you're building rather than using standard organizational templates
Topics
Transcript
Plus you have a complete disparate disciplines here. I'm sure you have specialists in each one of these high bandwidth memory, the network and the NV link, the NICs, the optics and the copper that you're doing, the power delivery, the cooling, all of that. I mean, there's like world experts in each of those. How do you get them in a room together to figure out my staff is so large. What's the product? Can you take me through the process of the specialists and the journalists? Like how do you put together the rack when you know this, the set of things you have to shove into a rack together? Like what does that process look like of…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Did the plague kill half the Roman Empire? | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses the Plague of Justinian (541 AD), arguing against the maximalist claim that it killed 50% of the Roman population. He contends that modern pathogen identification combined with historical evidence shows the plague had far less impact than commonly assumed, as evidenced by Justinian's continued military campaigns and taxation during the outbreak.
Persian Empire vs Roman Empire: The war that destroyed both empires | Anthony Kaldellis
Anthony Kaldellis discusses the Byzantine-Persian War (602-628 CE) and its catastrophic consequences for both empires, explaining how Heraclius's civil war weakened Roman defenses, the eventual Arab conquests stripped away the empire's richest provinces, and the subsequent Byzantine survival through military innovation like Greek fire and strategic defensive reorganization.
Why the Roman Empire collapsed in the East | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses how the Eastern Roman Empire, despite territorial losses, maintained remarkable internal stability and could have lasted another thousand years without external invasions. He attributes this resilience to two factors: authorities convincingly persuading subjects they ruled on their behalf, and a unified Roman and Orthodox identity that made the alternatives to imperial rule seem worse.
Lessons from the Roman Empire for modern-day - historian explains | Anthony Kaldellis
Historian Anthony Kaldellis discusses lessons from the 2,200-year Roman Empire for modern America, focusing on the importance of building lasting institutions that serve the majority, aligning foreign policy rhetoric with actual military actions, and the persistent elements of human nature across centuries.
The enemies of the Roman Empire who almost destroyed it | Anthony Kaldellis and Lex Fridman
Anthony Kaldellis discusses how the Byzantine Empire survived multiple crises through cycles of decline and recovery, arguing that external threats rather than internal decay caused the 11th-century collapse, and emphasizing that historians should focus on the institutional structures and mechanisms that enabled long-term resilience rather than dramatic peak moments.