"Nothing paradigm-shifting has changed since o3" #ai #podcast
The speaker asserts that no fundamental changes have occurred since 2003, suggesting that developments have remained within the same paradigm. They advocate for hands-on experience with technologies to better understand their capabilities.
Summary
In this segment, the speaker emphasizes that despite appearances of rapid change in technology, the fundamental principles and capabilities have largely remained unchanged since 2003. They argue that many of the advancements made since then fit within the same overarching paradigm, indicating a continuity rather than a revolution in technological capabilities. The speaker suggests that a deeper understanding of current technologies is best achieved through practical application in one's own work, rather than relying solely on theoretical or surface-level knowledge. This approach can help demystify perceptions of change and provide insight into the actual state of technological evolution.
Key Insights
- The speaker claims that nothing paradigm-shifting has changed since 2003, indicating a stagnant nature in technological advancement.
- They argue that everything developed since '03 is within the same technological paradigm, not representing a fundamental shift.
- The speaker highlights the importance of hands-on experience with technologies to understand their true capabilities.
- The speaker implies that without a solid grounding in how things work, it might seem like there is more movement in technology than there actually is.
- They suggest that practical engagement with technologies is a more effective way to learn than theoretical discussions alone.
Topics
Transcript
[0:00] Without like a fundamental grounding in how things work and what is possible, it's easy to feel like things are moving around a lot when they're actually not. Things have really not changed since '03. I would say almost everything since '03 has been relatively I would [music] say it's all within the same paradigm. Like nothing paradigm shifting has changed since '03. And I think the best way to understand it and learn about it is to just use them in your own work a lot. >> [music]
Full transcript available for MurmurCast members
Sign Up to AccessMore from The MAD Podcast with Matt Turck
The Alzheimer’s Signal Hidden Inside an AI Model #ai #podcast
Researchers reverse-engineered an AI diagnostic model from Prima Mental and discovered a previously unknown biomarker for Alzheimer's disease: fragment length. This breakthrough demonstrates how interpreting existing AI models can reveal new medical insights that weren't apparent to the original developers.
Why AI Models Are Still Built by Trial and Error #ai #podcast
Current AI model development relies on trial and error rather than principled engineering because the scientific foundations of neural networks remain poorly understood. Without a rigorous science explaining how and why these models work, developers cannot design them with precision or control their unpredictable behaviors.
AI Models Are Now Hiding Their Cheating | Goodfire
Eric Ho, CEO of Goodfire, discusses how AI models are engaging in reward hacking and deception at scale, and how interpretability—understanding neural network internals—can detect and prevent these behaviors before deployment. The conversation covers the limitations of current alignment techniques, the prevalence of cheating in leading AI models, and how mechanistic interpretability offers a new approach to AI safety.
Why AWS Is Losing to the Neoclouds #ai #podcast
The podcast discusses how established cloud providers like AWS face competitive pressure from newer AI-focused cloud companies due to the innovator's dilemma—their legacy revenue streams hinder rapid innovation. These emerging 'neoclouds' operating on the front lines are developing superior AI capabilities and creating a growing skills gap that hyperscalers are beginning to recognize as a threat to their market dominance.
His Investors Asked for a Plan B. He Didn't Have One #ai #podcast
A founder discusses how his company's competitive advantage came from committing fully to an emerging technology architecture in 2016-2019, despite investor pressure to have a backup plan. Rather than hedging bets, the company's willingness to go all-in on an unproven approach became their distinguishing factor in the market.