100 Years of Artificial Intelligence Explained
This transcript covers 100 years of AI history, from Alan Turing's Enigma-cracking Bombe machine in WWII through the symbolic vs. neural network debates, the breakthroughs of AlexNet and transformers, and culminating in the modern AI gold rush dominated by OpenAI, Google, and Anthropic. The narrative traces how foundational mathematical ideas, hardware advances, and massive datasets converged to produce today's large language models. It ends with Claude Code emerging as the dominant developer tool by late 2025.
Summary
The transcript opens in September 2012 with Alex Krizhevsky training a neural network on two gaming GPUs as a side project, framing it as the seed of a technological revolution. The story then rewinds to WWII, where Alan Turing designed the electromechanical Bombe machine to crack the German Enigma code, which had over 100 quintillion possible settings. More than 200 Bombes eventually broke over 4,000 German messages per day, shortening the war by an estimated 2–4 years. Turing later published his famous 'imitation game' paper, proposing that a machine able to fool a human through text could be considered intelligent.
The narrative then covers the 1956 Dartmouth Conference, where John McCarthy — alongside Claude Shannon and others — formally named the field 'artificial intelligence.' The field quickly split into two competing schools: Marvin Minsky's symbolic approach (rule-based logic) and Frank Rosenblatt's neural network approach (brain-inspired adaptive learning). Rosenblatt built the Perceptron in 1958, which the U.S. Navy celebrated as the embryo of a conscious machine. However, Minsky and a colleague mathematically proved in 1969 that neural networks had hard learning limits, effectively killing that research direction for years. Two AI winters followed — one after government-funded research failed to deliver, and another in 1987 when the commercial expert systems boom collapsed as cheaper workstations made specialized Lisp machines obsolete.
The neural network revival began in 1986 when Geoffrey Hinton and colleagues published a paper on backpropagation, solving the problem of tracing errors through multi-layered networks. But the mathematical fix outpaced available hardware. It wasn't until Nvidia's powerful GPUs — built for gaming — became available that training deep networks became practical, cutting training time from months to days. The data problem was solved by Fei-Fei Li's ImageNet project, which assembled 14 million labeled photos by 2010 and launched an annual recognition competition.
In 2012, Krizhevsky's AlexNet entered that competition and achieved 15% error — 11 points better than the previous year's winner — without any hand-coded rules, simply by learning from the data itself. This result instantly made every other approach look obsolete and triggered a mass hiring of deep learning talent by Google, Facebook, and Microsoft. DeepMind's acquisition by Google in 2014 and AlphaGo's historic 2016 victory over 18-time Go world champion Lee Sedol — including a move no human would have conceived — demonstrated that AI could generate genuinely novel strategies.
The modern era of generative AI was launched by the 2017 Google paper 'Attention Is All You Need,' which introduced the transformer architecture. Unlike sequential word-by-word processing, transformers read entire passages in parallel, enabling far better context retention. OpenAI adapted the transformer to predict the next word at scale, releasing GPT-1 (2018), GPT-2 (2019), and GPT-3 (2020), before wrapping the technology into ChatGPT in late 2022. ChatGPT reached 1 million users in 5 days and 100 million in 2 months, triggering a $10 billion Microsoft investment and a Google internal 'code red.'
Anthropicpublicly launched Claude in March 2023, named after Claude Shannon. Google responded with Gemini in December 2023. The three companies diverged in strategy: OpenAI targeted general consumers, Google embedded AI across its ecosystem, and Anthropic focused on developers. Claude 3.5 Sonnet's Artifacts feature and the February 2025 release of Claude Code — a command-line tool capable of reading projects, editing files, and building software autonomously — made it the dominant tool for serious developers. By November 2025, Claude Code was generating over $1 billion annually. Amazon committed $25 billion and Google $40 billion to Anthropic in April 2026, underscoring how central Anthropic had become. The transcript closes by noting that while ChatGPT still leads the consumer market, Claude Code dominates the power-user and developer space, and the AI race continues to accelerate.
Key Insights
- Turing's Bombe machines broke over 4,000 German Enigma messages per day by the end of WWII, and Turing later argued the field should stop debating whether machines can think and instead define what would prove that they could — a reframing that became the foundation for AI research.
- Minsky's 1969 mathematical proof that Rosenblatt's Perceptron had a hard ceiling on what it could learn effectively ended neural network funding for years — even though the proof did not validate Minsky's own symbolic approach, which also failed to produce useful results.
- Hinton's 1986 backpropagation paper solved the core theoretical problem with multi-layer neural networks, but the approach remained impractical for another 20 years because the hardware — specifically the parallel math capabilities of Nvidia gaming GPUs — did not yet exist.
- AlphaGo's 'Move 37' in game two against Lee Sedol — a stone placement no professional player would have considered — demonstrated that AI had moved beyond pattern recognition into generating genuinely novel strategic thought, leading Lee Sedol to retire and declare the AI undefeatable.
- The eight Google authors of the 2017 'Attention Is All You Need' paper created the transformer to improve language translation speed, but did not realize they had invented the foundational architecture behind what would become modern generative AI, including ChatGPT and Claude.
Topics
Transcript
[0:00] September 2012. In a bedroom in his parents house, 26-year-old Alex Kresvki is creating a system inside two gaming graphics cards. He's training the system to recognize pictures. For him, this is just a side project that his friends convinced him to do to win a competition. But what he doesn't know is that he's about to build the system that will become the foundation of one of the greatest inventions in history. This is the 100-year history of artificial intelligence. 1939, Britain is losing the Battle of the Atlantic. German submarines are sinking ships faster than the Allies can replace them. However, the Allies manage [0:32] to get information about the German code machine that's sending military orders…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Nate Herk | AI Automation
Every Codex Concept Explained for Non-Coders
A comprehensive tutorial explaining 18 core Codex concepts for non-technical users, organized into four parts covering basics (projects, agents, agent loops, goals), environments (on-premises vs. cloud, working trees), customization (AI models, effort levels, permissions, skills), and scaling tools (browser, sites, subagents, scheduled tasks, voice mode).
Claude Code Mods Are Game Changers. This One Saves Me Money.
Claude Code now supports mods that allow customization of the Cloud desktop app. A user demonstrates a cache management mod that tracks usage data, displays costs, monitors session limits, and provides notifications before cache expiration to help optimize spending.
5 Claude Code Mods That Everyone Needs
The video demonstrates five useful Claude Code modifications (mods) that are plugins enabling customization of the Claude desktop application interface. The creator showcases practical mods including Cache Keeper for token management, Recording Mode for privacy, Goal tracking interface, and Collision Guard for file conflict detection, explaining how anyone can create mods using plain language.
How to Actually Build & Sell Software with AI as a Non-Techie
Dave Fabrikant, a 10+ year Python programmer and AI engineer, discusses how AI coding tools have transformed software development from a specialized skill into an accessible field for non-technical founders. He explains the progression from personal tools to scalable products, emphasizing architecture, security best practices, and the shift from specification-driven to intent-based development.
I Tested Codex's NEW $500/mo Ultrafast mode
A reviewer tests Codex's new $500/month Ultrafast mode, which claims to be 8x faster than standard mode. While results vary by task complexity, Ultrafast delivers significant speed improvements but at substantially higher resource consumption, making it suitable primarily for time-sensitive projects.