Nemotron 3: NVIDIA's new open-source AI model explained | Jensen Huang and Lex Fridman
Jensen Huang explains NVIDIA's vision for open-source AI, discussing the release of Nematron 3, a 120 billion parameter model that combines transformer and SSM architectures. He outlines three key reasons for NVIDIA's open-source strategy: co-design research, democratizing AI access, and enabling AI development across diverse industries and modalities.
Summary
In this conversation, Jensen Huang discusses NVIDIA's approach to open-source AI, specifically highlighting the release of Nematron 3, a 120 billion parameter model available through platforms like Perplexity. Huang presents three fundamental reasons for NVIDIA's commitment to open-source AI development. First, he emphasizes that building AI models helps NVIDIA understand how AI is evolving, which is crucial for their role as an AI computing company. He notes that Nematron 3 isn't just a pure transformer model but combines transformer and SSM architectures, drawing on NVIDIA's early research in conditional GANs and progressive GANs that led to diffusion models. This research gives them visibility into what computing systems will be needed for future AI models as part of their 'extreme co-design strategy.' Second, Huang acknowledges the balance between proprietary world-class models as products and the need for AI to diffuse into every industry, country, and research institution. He argues that if everything remains proprietary, it becomes difficult for researchers and innovators to build upon existing work, making open source fundamentally necessary for widespread AI adoption. Third, he recognizes that AI extends far beyond language and will likely incorporate tools, models, and sub-agents trained on diverse modalities including biology, chemistry, physics, and thermodynamics. NVIDIA's role is to ensure that specialized AI applications in weather prediction, biology, physical AI, and other domains can be pushed to their limits. While NVIDIA doesn't build cars or discover drugs directly, they want to ensure that car companies and pharmaceutical companies like Lily have access to the best AI systems for their specific needs. Huang concludes by noting NVIDIA's comprehensive approach to open sourcing, which includes not just the models and weights, but also the data and methodology used to create them.
Key Insights
- Jensen Huang explains that Nematron 3 is not a pure transformer model but combines transformer and SSM architectures, building on NVIDIA's early research in conditional GANs and progressive GANs
- Huang argues that building AI models is essential for NVIDIA as an AI computing company because it gives them visibility into what kind of computing systems will be needed for future models as part of their extreme co-design strategy
- Jensen Huang states that while NVIDIA wants world-class proprietary models as products, they also recognize that if everything is proprietary, it becomes hard for researchers to innovate and build upon existing work
- Huang emphasizes that NVIDIA has the scale, skills, and motivation to continue building AI models indefinitely, which gives them the capability to activate every industry, researcher, and country to join the AI revolution
- Jensen Huang argues that AI extends beyond language and will likely use tools and models trained on diverse modalities like biology, chemistry, and physics, requiring specialized AI development for different domains like weather prediction and drug discovery
Topics
Transcript
[0:03] to take a small tangent because you mentioned open source. I have to uh go to Perplexity here who you have been a a fan of a long time. >> I love it. Yeah. >> And thank you for releasing open source Nematron 3 super which you can also use inside Perplexi to look stuff up >> now which is uh 120 billion parameter open weight uh model. uh what's your vision with open source? So you mentioned China with with Deep Seek with Miniax with all [0:34] these companies really pushing forward the open-source uh AI movement and Nvidia is really leading the way in um close to state-of-the-art open source LLMs. What's your vision there? First, if…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Lex Clips
How the Civil War ended | Gary Gallagher and Lex Fridman
Gary Gallagher and Lex Fridman discuss how the Civil War ended, focusing on Lee's surrender at Appomattox and Grant's magnanimous treatment of Confederate forces. They explore how Grant's generous surrender terms, influenced by Lincoln's reconciliation goals, contrasted with calls from Radical Republicans for harsher punishment and how this approach facilitated national reunification rather than perpetuating resentment.
White supremacy after the Civil War | Gary Gallagher and Lex Fridman
Historian Gary Gallagher discusses Reconstruction, white supremacy, and Confederate memory in post-Civil War America, emphasizing that Northern troops were insufficient to enforce equal rights for freed Black people, and explaining how the "Lost Cause" narrative allowed the South to reframe the war's purpose while Jim Crow became the mechanism for maintaining white supremacy.
The truth about the Civil War - Why people volunteered to fight | Gary Gallagher and Lex Fridman
Historian Gary Gallagher discusses the distinction between causation and motivation in Civil War volunteerism, explaining that while slavery caused the war, most Northern soldiers were motivated by belief in preserving the Union as a democratic republic. He emphasizes that understanding citizen-soldiers' sense of civic duty and American exceptionalism is essential to comprehending why ordinary people risked their lives for the Union.
Christianity and religion during the Civil War | Gary Gallagher and Lex Fridman
Both Union and Confederate sides during the American Civil War were overwhelmingly Protestant Christian and used religious justification for their military efforts. Interestingly, Confederate leaders like Lee and Jackson were notably more overtly religious in their official communications than Union commanders like Grant and Sherman.
Racism in America after slavery was abolished | Gary Gallagher and Lex Fridman
Gary Gallagher discusses how abolishing slavery was only the beginning of achieving equal rights for Black Americans, noting that most Northern whites prioritized saving the Union over ensuring racial equality. He explains that legal changes like the Civil Rights Act took over a century to achieve, while the deeper work of changing societal attitudes and prejudices remains ongoing and vulnerable to exploitation.