No 1-on-1 meetings: How Jensen Huang runs NVIDIA | Lex Fridman Podcast Clips
Jensen Huang explains NVIDIA's extreme co-design approach, where they optimize across the entire technology stack from software to hardware to systems. He manages 60 direct reports without one-on-one meetings, instead using group discussions where all experts collaborate on problems since every component affects others.
Summary
Jensen Huang describes NVIDIA's unique approach to building complex AI systems through what he calls 'extreme co-design.' This involves optimizing across multiple layers simultaneously: software architectures, chips, systems, system software, algorithms, and applications. The challenge extends beyond just CPUs and GPUs to include networking chips, switches, power delivery, and cooling systems, all of which must work together efficiently in power-hungry AI systems. Huang emphasizes that company organization should reflect the product being built, criticizing the standard 'hamburger' organizational charts used by most companies regardless of their output. His management structure reflects this philosophy - he has 60 direct reports, mostly with engineering backgrounds, who are experts in different areas like memory, CPUs, optics, GPUs, and algorithms. Rather than conducting one-on-one meetings, which would be logistically impossible, he uses group problem-solving sessions where all relevant experts participate. This approach works because when discussing any component (like cooling or networking), other team members can immediately identify conflicts or dependencies with their areas (power distribution, memory, etc.). Team members are expected to know when to contribute and are held accountable if they miss opportunities to provide valuable input. This collaborative approach enables the extreme co-design that NVIDIA requires to build integrated AI systems.
About this episode
Lex Fridman Podcast full episode: https://www.youtube.com/watch?v=vif8NQcjVf0 Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/cv9756-sb See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc. *GUEST BIO:* Jensen Huang is the co-founder and CEO of NVIDIA, the world's most valuable company and the engine powering the AI computing revolution. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *EPISODE LINKS:* NVIDIA: https://nvidia.com NVIDIA on X: https://x.com/nvidia NVIDIA AI on X: https://x.com/NVIDIAAI NVIDIA on YouTube: https://youtube.com/@NVIDIA NVIDIA on Instagram: https://www.instagram.com/nvidia/ NVIDIA on LinkedIn: https://www.linkedin.com/company/nvidia/ NVIDIA on Facebook: https://www.facebook.com/NVIDIA/ NVIDIA on GitHub: https://github.com/NVIDIA Nemotron: https://developer.nvidia.com/nemotron *SPONSORS:* To support this podcast, check out our sponsors & get discounts: *Perplexity:* AI-powered answer engine. Go to https://lexfridman.com/s/perplexity-cv9756-sb *Shopify:* Sell stuff online. Go to https://lexfridman.com/s/shopify-cv9756-sb *LMNT:* Zero-sugar electrolyte drink mix. Go to https://lexfridman.com/s/lmnt-cv9756-sb *Fin:* AI agent for customer service. Go to https://lexfridman.com/s/fin-cv9756-sb *Quo:* Phone system (calls, texts, contacts) for businesses. Go to https://lexfridman.com/s/quo-cv9756-sb *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman
Key Insights
- Replace one-on-one meetings with group problem-solving sessions when building complex integrated products, as experts in different components can immediately identify cross-functional conflicts and dependencies
- Design your company's organizational structure to mirror the architecture of the product you're building rather than using standard organizational templates
Topics
Transcript
Plus you have a complete disparate disciplines here. I'm sure you have specialists in each one of these high bandwidth memory, the network and the NV link, the NICs, the optics and the copper that you're doing, the power delivery, the cooling, all of that. I mean, there's like world experts in each of those. How do you get them in a room together to figure out my staff is so large. What's the product? Can you take me through the process of the specialists and the journalists? Like how do you put together the rack when you know this, the set of things you have to shove into a rack together? Like what does that process look like of…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
Hard training in Dagestan: Comfort is the enemy of a champion | Khabib Nurmagomedov and Lex Fridman
Khabib Nurmagomedov discusses how adversity and difficult living conditions foster championship mentality in combat sports, arguing that hunger and necessity drive athletes more than comfort and wealth. He explains that wrestling requires minimal material resources compared to other sports, making mindset and coaching the true determining factors for success.
The psychology of fear in fighting | Khabib Nurmagomedov and Lex Fridman
Khabib Nurmagomedov discusses how elite athletes must confront and work through fear rather than ignore it, emphasizing that overcoming nervousness requires repeated competition and personal experience. He contrasts his own natural calmness before fights with other fighters who struggle with sleep and multiple emotions, arguing that mastering fear is an individual psychological journey.
Real Madrid vs FC Barcelona: Greatest teams in soccer history | Khabib Nurmagomedov and Lex Fridman
Khabib Nurmagomedov and Lex Fridman discuss the greatest soccer teams in history, comparing Barcelona's 2008-2012 dynasty with Real Madrid's 2014-2018 dominance. They argue that Messi and Ronaldo pushed each other to greater heights, and identify these two specific team rosters as the only comparable dream teams in club-level football.
Khabib's story of digging a big hole | Khabib Nurmagomedov and Lex Fridman
Khabib describes his father's training philosophy during summer camps in the mountains (2005-2007), where he and other young athletes were kept constantly busy with training and work tasks like digging holes. His father believed idle time during adolescence is dangerous, and children should always be developing skills and working toward their future goals.
Khabib on Daniel Cormier: He is one of the greatest fightersof all time | Khabib Nurmagomedov
Khabib Nurmagomedov praises Daniel Cormier as one of the greatest fighters of all time, highlighting his unique Olympic wrestling pedigree and multiple championship titles across weight classes. Despite their friendly relationship, Khabib emphasizes that DC's legacy is often overshadowed by his rivalry with Jon Jones, though DC deserves recognition among the top 10 greatest fighters.