Naveen Rao: 4D Computing, AI's Energy Wall & Beating Biology
Naveen Rao, CEO of Unconventional AI, presents a new 'dynamical computing' architecture designed to achieve 1000x power efficiency improvements over conventional computers by eliminating the von Neumann separation of memory and compute. He demonstrates the first physical dynamical computer prototype, which generates images using only nanojoules of energy, and argues this efficiency breakthrough is critical to solving AI's impending energy wall.
Summary
Naveen Rao discusses his career trajectory from founding Nirvana Systems (the first AI chip company in 2014) and scaling AI infrastructure at Intel, to his current venture Unconventional AI. He frames the core problem confronting AI: Google alone consumes 12 gigawatts of energy for AI services monthly, representing nearly 12% of global data center energy capacity, and at current growth rates, AI energy demand will exhaust available power in approximately 3 years.
Rao argues that the fundamental issue stems from how computers have been designed since the 1940s—they move vast amounts of information between separated memory and compute units. The human brain, by contrast, operates on only 20 watts and moves approximately 16 billion bits per second, while modern GPUs move 30 trillion bits per second in and out of memory. This architectural inefficiency is the primary energy consumer.
To solve this, Unconventional AI is rebuilding computers from first principles using dynamical systems theory—using physics-based oscillatory systems rather than traditional digital abstractions. Rao unveiled Uno, an image generation model built on oscillators, and more significantly, announced the fabrication of the first physical dynamical computer chip, completed in just five months from company founding. This prototype generates images at 500 nanojoules per image compared to millijoules for conventional GPUs—a difference of several orders of magnitude.
The new architecture, termed '4D computing,' integrates compute and memory into unified dynamical elements using three physical dimensions (die stacking, planar layout) plus the time dimension. Rather than moving bits between separated components, the system's physics itself encodes computation and memory simultaneously. Rao positions this as a completely new paradigm beyond CPUs, GPUs, and compute-in-memory architectures.
Regarding commercialization, Rao projects a full product within two years—initially as a data center rack system serving tokens in/out over network. Models must be ported at the model layer rather than operation layer, requiring significant computational transition work but enabling existing model families to run on the new architecture. He recruited an interdisciplinary team spanning dynamical systems theorists, physicists, biologists, and chip architects, coordinated through Python-based libraries that express time-varying stochastic elements.
Rao frames the broader implications through the lens of reaching thermodynamic limits of intelligence per watt. Mammalian brains operate within 1-2 orders of magnitude of thermodynamic limits; current AI is 10 billion times away. He believes achieving 1000x efficiency over 3.5 years will enable ubiquitous distributed computing, mass robotics, and trigger a Jevons Paradox effect creating the largest market humanity has seen.
Key Insights
- Google alone processes 3.2 quadrillion tokens monthly, consuming 12 gigawatts of energy for AI services, which represents approximately 12% of all global data center energy capacity, and at current growth rates AI will exhaust available power in approximately 3 years.
- The human brain moves only 16 billion bits per second through its cortex while a modern GPU moves 30 trillion bits per second in and out of memory—a difference of nearly 2000x—and this information movement, not computation itself, drives energy consumption in current systems.
- Current computer architecture dating to 1945 (ENIAC) has remained fundamentally unchanged: they separate memory from compute and move bits back and forth between them, an optimization for speed rather than efficiency that doesn't contemplate the energy problem modern AI faces.
- Naveen Rao's team built the first physical dynamical computer in 5 months by January start, with the chip taped out in June and returned from fabrication with verified results—demonstrating nanojoule-level energy consumption (500 nanojoules per image) compared to millijoules for GPUs, representing many orders of magnitude improvement.
- The new 4D computing architecture eliminates the von Neumann separation of memory and compute by unifying them through dynamical systems where each computing element is simultaneously a memory element, using 3 physical dimensions via die stacking plus time as the fourth dimension.
Topics
Transcript
[0:00] Naveen Rao, co-founder and CEO of Unconventional AI, which is an AI chip startup. >> Best known for building and [music] selling two deep tech companies. >> Naveen is kind of definitionally outlier founder. >> When I came there, we had about a $20 million business and it was, you know, 7 or 800 million [music] when I left. >> think you really understand something until you can build it. >> Just because something is tried does not mean it's wrong. [music] >> I'm the opposite of an AI doomer. I think AI is the next evolution of humanity. >> We need innovation on the hardware substrate to actually build true intelligence. [0:31] >> Please welcome Naveen Rao. >>…
Full transcript available for MurmurCast members
Sign Up to AccessMore from All-In Podcast
“They Got a $50,000 Check”: Meta’s Data Center Windfall for Local Teachers
Meta's data center investment in Richland Parish, Louisiana generated significant sales tax revenue that directly benefited teachers through dedicated salary increases. Teachers received checks totaling approximately $45,000-$50,000 over two distribution periods, with sales tax collections spiking from normal levels of 5-10% to as high as 260%.
How Robots Learn: Much Slower Than Humans At First, Then Infinitely Scalable
The speaker discusses the evolution of learning in robots compared to humans, emphasizing that while humans learn efficiently with minimal data, robots require significantly more data to learn effectively. However, once a robot learns a task, that knowledge can be shared across all robots of that type, leading to infinite scalability.
Former Navy Seal Details First Autonomous Rescue Mission Near the Strait of Hormuz
A former Navy SEAL discusses a significant autonomous rescue mission involving a fully autonomous speedboat named Corsair, tasked with rescuing downed American pilots in the Strait of Hormuz. This mission represents a critical milestone in military operations, showcasing the ability to conduct rescues without further endangering soldiers.
GameStop CEO: “Why Does Everyone Want Us to Fail?”
GameStop CEO argues that the media and management are biased against GameStop's success, despite his financial commitment to the company. He highlights the disparity between overpaid management teams and those willing to risk their own capital.
Friedberg: Elon’s $17B Terafab Could Be the Greatest Chip Fab on Earth
The discussion highlights Elon Musk's ambitious vision for a semiconductor fabrication site, which could reduce U.S. dependence on Taiwan and China for chips. The potential success of this venture is tied to profits from Starlink and Musk's investment strategies.