Open Source Wins, AGI Is Here, and Scorsese’s AI Toolkit with CEOs of Cerebras & Black Forest Labs
Andrew Feldman (Cerebras CEO) and Robin Rombach (Black Forest Labs CEO) discuss the massive infrastructure buildout for AI, the emergence of AGI through reasoning models, and the role of generative AI in creative production. They explore how AI is becoming a tool for intent understanding, the importance of open-source models, and applications ranging from data center chip design to filmmaking partnerships with Martin Scorsese.
Summary
The conversation opens with a discussion of the unprecedented scale of AI infrastructure buildout currently underway globally. Feldman explains that data centers being constructed in the US, Canada, Nordics, Europe, Middle East, and Central Asia will consume more power in coming years than humanity used over the previous 50 years. Individual buildings are the size of football fields with power consumption exceeding midsize cities. Cerebras has a $25 billion backlog, and companies like OpenAI, Anthropic, Google, and Microsoft are insatiable in their demand, pre-ordering chips before production is complete. This represents a fundamental shift where demand far exceeds supply.
The hosts discuss token maxing—the overconsumption of AI tokens—and whether this represents genuine value creation or wasteful experimentation. Feldman argues that while some experimentation is wasteful, the net value is enormous, comparing it to early AWS adoption where engineers were given unlimited cloud credits. He notes enterprises are now moving toward strategic token allocation, with smarter personnel understanding systems-level deployment emerging as a critical skill. The conversation highlights how AI is transitioning from being a tool that requires precise prompting to one that understands user intent and suggests improvements the user didn't explicitly request.
A major focus is on reasoning models and inference. The hosts discuss Hermes agents and GLM-52 models, noting how unlimited compute enables extended reasoning chains. Feldman explains that Cerebras's inference chips are optimized for these reasoning workloads, which consume massive numbers of tokens internally. He notes Cerebras has broken Moore's Law, with plans to achieve more than 2x improvement in the next 18 months, moving away from traditional GPU architectures with their geometric limitations.
The conversation addresses open-source models versus frontier models. The hosts argue there's room for both: frontier models (OpenAI, Anthropic, Gemini) for hard problems, and open-source models for routine tasks. Feldman supports open-source development from a sovereignty and dependency perspective, noting companies want control over their infrastructure after historical lessons with Intel and GPU manufacturers. Concerns about data sovereignty and regulatory compliance in regulated industries (finance, healthcare) are driving adoption of on-premises open-source solutions.
On the Grok/reasoning model rollout debate, Feldman takes a nuanced stance. While noting the government's request for staged deployment testing before release isn't unreasonable—comparing it to pharmaceutical testing and cybersecurity red-teaming—he critiques the politicization of the decision. He argues that technical concerns about cyber threats are legitimate, but polarization prevents clear thinking. He emphasizes that both sides will make smart and dumb decisions, and the government's rank-and-file teams are trying hard to navigate unprecedented territory.
Rombach discusses Black Forest Labs' work on multimodal generative models spanning image, video, audio, and action prediction. He emphasizes the paradigm shift from simple text-to-image systems to complex multimodal models. The key innovation is latent diffusion—compressing natural data into efficient representations, then training transformers on those compressed spaces. This enables efficient generation across modalities.
A significant portion covers the Martin Scorsese partnership. Rather than proposing Scorsese use Black Forest's tools to create full films, Rombach positions them as a brainstorming and visualization medium. Scorsese can externalize his mental picture of a scene, iterate on visual outputs, and communicate his vision more effectively than through language alone. Rombach rejects the notion of a predetermined "correct" use case, emphasizing the model as a medium that different creators will deploy differently.
Rombach discusses practical applications beyond filmmaker use: startups using the tools for launch videos, the Bitcoin movie that eliminated green screens by generating scenery on soundstages, and the trajectory toward robotics. He notes the technology is rapidly improving in resolution and temporal coherence, unlocking more demanding production use cases. The conversation emphasizes that current video generation still requires human-in-the-loop iteration for best results.
On IP and content libraries, Rombach explains Black Forest restricts generation of certain trademarked IP in public tools but partners with IP holders to develop customized models. He suggests the most interesting future involves interactive content creation tools and enabling fan creators to develop new stories within established universes (referencing George Lucas's permission model for fan films). Licensing frameworks could allow consumers to customize creative experiences while compensating rights holders.
The hosts discuss both the economic dislocation and abundance created by AI. Feldman acknowledges some workers will face disruption (comparing it to carriages and horses), but emphasizes the pro side of the ledger: curing cancer, unlimited energy, unlimited education, and personalized AI tutoring (revisiting Socratic methods at scale). Rombach notes that training data can come from synthetic generation, YouTube analysis, or fine-tuning on specific robot hardware, with the goal of eventually reaching prompt-based control.
Key Insights
- Data centers being built across the globe will consume more power in the next several years than humanity used over the previous 50 years, with individual buildings having power consumption exceeding midsize cities
- Unlimited tokens enables unlimited reasoning, allowing models to run for 24-48 hours producing weeks or months worth of thinking equivalent, which fast inference chips like Cerebras can accomplish in dramatically compressed timeframes
- Cerebras has broken traditional Moore's Law trajectory and expects more than 2x improvement in the next 18 months because newer architectures have room for optimization that 20-year-old GPU architectures lack
- Latent diffusion works by compressing natural data (images, video, audio) into efficient representations, then training transformers on those compressed spaces, enabling the same model to generate across multiple modalities and predict actions for robotics
- Martin Scorsese uses generative models primarily as a visualization and brainstorming tool to externalize mental pictures of scenes and communicate his creative vision more effectively than language allows, rather than as an automated filmmaking system
Topics
Transcript
[0:00] We are in the race for super intelligence and uh Andrew Feldman is back uh and obviously CEO and founder of uh Cerebras doing inference chips pioneered the space had a successful IPO. We've talked about this a couple of times. We got to see each other in January at Davos. IPO happens. Uh the boys and I got to sit with you recently. >> That was fun >> at liquidity. >> That was really that was really fun. >> Had a great discussion with the boys. I wanted to deep dive with you about a [0:30] couple of topics. The first one is the buildout of AI. We've never seen a build out like this since, you know,…
Full transcript available for MurmurCast members
Sign Up to AccessMore from All-In Podcast
How Robots Learn: Much Slower Than Humans At First, Then Infinitely Scalable
The speaker discusses the evolution of learning in robots compared to humans, emphasizing that while humans learn efficiently with minimal data, robots require significantly more data to learn effectively. However, once a robot learns a task, that knowledge can be shared across all robots of that type, leading to infinite scalability.
Former Navy Seal Details First Autonomous Rescue Mission Near the Strait of Hormuz
A former Navy SEAL discusses a significant autonomous rescue mission involving a fully autonomous speedboat named Corsair, tasked with rescuing downed American pilots in the Strait of Hormuz. This mission represents a critical milestone in military operations, showcasing the ability to conduct rescues without further endangering soldiers.
GameStop CEO: “Why Does Everyone Want Us to Fail?”
GameStop CEO argues that the media and management are biased against GameStop's success, despite his financial commitment to the company. He highlights the disparity between overpaid management teams and those willing to risk their own capital.
Friedberg: Elon’s $17B Terafab Could Be the Greatest Chip Fab on Earth
The discussion highlights Elon Musk's ambitious vision for a semiconductor fabrication site, which could reduce U.S. dependence on Taiwan and China for chips. The potential success of this venture is tied to profits from Starlink and Musk's investment strategies.
Google’s AI Brain Drain, SpaceX's Huge Quarter, Airtable’s 90% Collapse, US Data Fuels China AI
The All-In podcast discusses Google's AI leadership exodus and restructuring, SpaceX's spectacular earnings with $7.8B revenue (up 92% YoY) and $2.6B in AI compute rental revenue, Airtable's acquisition by Bending Spoons for $1.28B (90% below peak valuation), and concerns about U.S. training data being sold to Chinese AI companies.