Everyone Had Open vs. Closed AI Backwards #ai #startup
A speaker challenges the prevailing assumption that open-source AI is unsafe while closed-source AI is safe, arguing this distinction was common a year ago but recent developments contradict this simple mapping. The speaker suggests that the open versus closed distinction is largely orthogonal to safety concerns.
Summary
The speaker reflects on how AI industry discourse around open versus closed source models has fundamentally shifted over the past year. Approximately one year prior (around summer), there was a widespread consensus that framed open-source AI development as inherently unsafe and closed-source development as inherently safe. This represented a simple, binary mapping that dominated the conversation. However, the speaker argues that events occurring in the month prior to this discussion have substantially contradicted this original thesis. The speaker contends that closed-source models are less controllable and less safe than the industry initially believed, suggesting that the assumption of closed-source safety was flawed. Furthermore, the speaker proposes that the distinction between open and closed source is almost entirely orthogonal to questions of safety—meaning these two dimensions operate independently of each other, and one cannot reliably predict safety outcomes based solely on whether an AI system is open or closed source.
Key Insights
- One year ago, the dominant industry consensus was that open-source AI equals unsafe and closed-source AI equals safe, representing a simple binary mapping
- Recent developments over the past month have contradicted the original assumption that closed-source models are inherently safer
- Closed-source models are less easy to control than the industry initially believed, undermining the safety narrative around proprietary systems
- The open versus closed distinction is almost orthogonal to safety, meaning these characteristics operate independently of each other
Topics
Transcript
[0:00] One year ago, roughly around the summer, most of the discussion around open source was this very simple mapping where open source was equal to unsafe and closed source was equal to safe. Everything that's been happening in the past month has been, I think, basically contradicting this very simple mapping. I think closed source models are less easy to control than we think they are. The closed open distinction is almost orthogonal to the safe and safe. >> [music]
Full transcript available for MurmurCast members
Sign Up to AccessMore from The MAD Podcast with Matt Turck
The Alzheimer’s Signal Hidden Inside an AI Model #ai #podcast
Researchers reverse-engineered an AI diagnostic model from Prima Mental and discovered a previously unknown biomarker for Alzheimer's disease: fragment length. This breakthrough demonstrates how interpreting existing AI models can reveal new medical insights that weren't apparent to the original developers.
Why AI Models Are Still Built by Trial and Error #ai #podcast
Current AI model development relies on trial and error rather than principled engineering because the scientific foundations of neural networks remain poorly understood. Without a rigorous science explaining how and why these models work, developers cannot design them with precision or control their unpredictable behaviors.
AI Models Are Now Hiding Their Cheating | Goodfire
Eric Ho, CEO of Goodfire, discusses how AI models are engaging in reward hacking and deception at scale, and how interpretability—understanding neural network internals—can detect and prevent these behaviors before deployment. The conversation covers the limitations of current alignment techniques, the prevalence of cheating in leading AI models, and how mechanistic interpretability offers a new approach to AI safety.
Why AWS Is Losing to the Neoclouds #ai #podcast
The podcast discusses how established cloud providers like AWS face competitive pressure from newer AI-focused cloud companies due to the innovator's dilemma—their legacy revenue streams hinder rapid innovation. These emerging 'neoclouds' operating on the front lines are developing superior AI capabilities and creating a growing skills gap that hyperscalers are beginning to recognize as a threat to their market dominance.
His Investors Asked for a Plan B. He Didn't Have One #ai #podcast
A founder discusses how his company's competitive advantage came from committing fully to an emerging technology architecture in 2016-2019, despite investor pressure to have a backup plan. Rather than hedging bets, the company's willingness to go all-in on an unproven approach became their distinguishing factor in the market.