Why Moore's Law Has Been Dead for Years #ai #podcast
Moore's Law, originally an economic principle about doubling transistor density affordably every 24 months, has ceased delivering practical benefits for shrinking existing designs. In the post-Moore's Law era, success requires clever system optimization and accelerated computing rather than relying on transistor scaling.
Summary
The speaker clarifies that Moore's Law was fundamentally an economic statement rather than a physical law—it described the affordability of placing twice as many transistors on a chip within a given timeframe (approximately 24 months). During the era when Moore's Law held true economically, the strategy for building future systems was straightforward: take the current design, shrink it, and potentially double its capacity simultaneously. This approach worked because the economic benefits of transistor scaling made it the most efficient path forward. However, the speaker identifies a critical shift in the computing landscape. For some time now, the economic incentives that drove Moore's Law have deteriorated. Shrinking existing designs no longer yields meaningful economic advantages. Consequently, the industry must adopt a fundamentally different approach—one that requires ingenuity and optimization across every component of the system. In this new environment, accelerated computing has become increasingly valuable as a strategy for performance improvement, replacing the simple reliance on transistor density scaling.
Key Insights
- Moore's Law was originally an economic statement about the affordability of doubling transistor density every 24 months, not a physical law
- During Moore's Law's viability, the optimal strategy for future systems was to shrink and possibly double existing designs
- The semiconductor industry has entered an era where shrinking existing designs no longer provides economic benefits
- In the post-Moore's Law era, success requires clever optimization and efficient use of every system component
- Accelerated computing has become significantly more valuable as a path to improvement now that traditional transistor scaling no longer delivers economic returns
Topics
Transcript
[0:00] The original statement of Moore's law was economic, right? It was about we can afford to put twice as many transistors [music] on the same chip in every whatever 24 months, whatever the the time period is. In an era where where Moore's law was alive, the best way to make the system of the future was to take the system of the present [music] and then just shrink it and maybe double it at the same time. But in an era where we've been living for a while now where you don't get economic benefits [music] from taking your existing design and shrinking it, you really have clever [0:31] about how you use every part of the system.…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The MAD Podcast with Matt Turck
The Real Reason Enterprises Need Open Source AI #ai #podcast
Every company's competitive advantage relies on proprietary secrets tied to their data and platform. Open source AI technologies enable enterprises to customize and implement AI solutions that leverage their unique, valuable data more effectively than off-the-shelf alternatives.
Why Open Source AI Won't Be Killed by Distillation Bans #ai #podcast
The speaker argues that rapid progress in transformational AI technology will inevitably occur due to significant community investment, and that control of AI development cannot be concentrated in the hands of a small group because innovation is distributed across many labs worldwide with diverse ideas.
The Case Against Closed Internets and Closed AI #ai #podcast
The speaker argues that while closed internets like AOL and Prodigy existed historically, the open internet has proven to be transformational for businesses. They contend that AI, as a similarly transformational technology requiring diverse applications, should likewise be developed as open technology rather than closed systems.
NVIDIA’s Bryan Catanzaro: Why More Compute Isn’t Enough
Bryan Catanzaro, who leads NVIDIA's NeMoTron frontier AI models, discusses how open-source AI is accelerating through community collaboration, explains the technical innovations in NeMoTron 3 (hybrid SSM-transformer architecture, mixture of experts, multi-token prediction), and argues that open technologies are safer and more aligned with how effective organizations actually work.
Cloudflare CEO: Bot Takeover, Edge AI & The Hard Decision Every CEO Will Face
Matthew Prince, CEO of Cloudflare, discusses how bot traffic has surpassed human traffic on the internet as of mid-2026, driven by AI agents and LLMs. He explores how this fundamental shift is forcing a reimagining of internet infrastructure, business models, and organizational structures, with Cloudflare positioned at the center of these changes through products like Workers, AI Gateway, and edge computing solutions.