TechnicalNews

Naveen Rao: 4D Computing, AI's Energy Wall & Beating Biology

All-In Podcast

Naveen Rao, CEO of Unconventional AI, presents a new 'dynamical computing' architecture designed to achieve 1000x power efficiency improvements over conventional computers by eliminating the von Neumann separation of memory and compute. He demonstrates the first physical dynamical computer prototype, which generates images using only nanojoules of energy, and argues this efficiency breakthrough is critical to solving AI's impending energy wall.

Summary

Naveen Rao discusses his career trajectory from founding Nirvana Systems (the first AI chip company in 2014) and scaling AI infrastructure at Intel, to his current venture Unconventional AI. He frames the core problem confronting AI: Google alone consumes 12 gigawatts of energy for AI services monthly, representing nearly 12% of global data center energy capacity, and at current growth rates, AI energy demand will exhaust available power in approximately 3 years.

Rao argues that the fundamental issue stems from how computers have been designed since the 1940s—they move vast amounts of information between separated memory and compute units. The human brain, by contrast, operates on only 20 watts and moves approximately 16 billion bits per second, while modern GPUs move 30 trillion bits per second in and out of memory. This architectural inefficiency is the primary energy consumer.

To solve this, Unconventional AI is rebuilding computers from first principles using dynamical systems theory—using physics-based oscillatory systems rather than traditional digital abstractions. Rao unveiled Uno, an image generation model built on oscillators, and more significantly, announced the fabrication of the first physical dynamical computer chip, completed in just five months from company founding. This prototype generates images at 500 nanojoules per image compared to millijoules for conventional GPUs—a difference of several orders of magnitude.

The new architecture, termed '4D computing,' integrates compute and memory into unified dynamical elements using three physical dimensions (die stacking, planar layout) plus the time dimension. Rather than moving bits between separated components, the system's physics itself encodes computation and memory simultaneously. Rao positions this as a completely new paradigm beyond CPUs, GPUs, and compute-in-memory architectures.

Regarding commercialization, Rao projects a full product within two years—initially as a data center rack system serving tokens in/out over network. Models must be ported at the model layer rather than operation layer, requiring significant computational transition work but enabling existing model families to run on the new architecture. He recruited an interdisciplinary team spanning dynamical systems theorists, physicists, biologists, and chip architects, coordinated through Python-based libraries that express time-varying stochastic elements.

Rao frames the broader implications through the lens of reaching thermodynamic limits of intelligence per watt. Mammalian brains operate within 1-2 orders of magnitude of thermodynamic limits; current AI is 10 billion times away. He believes achieving 1000x efficiency over 3.5 years will enable ubiquitous distributed computing, mass robotics, and trigger a Jevons Paradox effect creating the largest market humanity has seen.

Key Insights

  • Google alone processes 3.2 quadrillion tokens monthly, consuming 12 gigawatts of energy for AI services, which represents approximately 12% of all global data center energy capacity, and at current growth rates AI will exhaust available power in approximately 3 years.
  • The human brain moves only 16 billion bits per second through its cortex while a modern GPU moves 30 trillion bits per second in and out of memory—a difference of nearly 2000x—and this information movement, not computation itself, drives energy consumption in current systems.
  • Current computer architecture dating to 1945 (ENIAC) has remained fundamentally unchanged: they separate memory from compute and move bits back and forth between them, an optimization for speed rather than efficiency that doesn't contemplate the energy problem modern AI faces.
  • Naveen Rao's team built the first physical dynamical computer in 5 months by January start, with the chip taped out in June and returned from fabrication with verified results—demonstrating nanojoule-level energy consumption (500 nanojoules per image) compared to millijoules for GPUs, representing many orders of magnitude improvement.
  • The new 4D computing architecture eliminates the von Neumann separation of memory and compute by unifying them through dynamical systems where each computing element is simultaneously a memory element, using 3 physical dimensions via die stacking plus time as the fourth dimension.

Topics

Dynamical systems computing architectureAI energy efficiency crisis and thermodynamic limitsVon Neumann architecture limitations4D computing paradigm (3 spatial + 1 temporal dimension)First physical dynamical computer prototypeBiological brain efficiency as proof of conceptSparsity and emergent behavior in neural networksCommercialization path and ecosystem requirementsOscillatory systems for computationJevons Paradox and market expansion

Transcript

[0:00] Naveen Rao, co-founder and CEO of Unconventional AI, which is an AI chip startup. >> Best known for building and [music] selling two deep tech companies. >> Naveen is kind of definitionally outlier founder. >> When I came there, we had about a $20 million business and it was, you know, 7 or 800 million [music] when I left. >> think you really understand something until you can build it. >> Just because something is tried does not mean it's wrong. [music] >> I'm the opposite of an AI doomer. I think AI is the next evolution of humanity. >> We need innovation on the hardware substrate to actually build true intelligence. [0:31] >> Please welcome Naveen Rao. >>…

Full transcript available for MurmurCast members

Sign Up to Access

More from All-In Podcast

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.