Inside Anthropic's $100 Billion Al Compute Commitment | CFO Krishna Rao
Krishna Rao discusses the intricate relationship between compute procurement and allocation at Anthropic, emphasizing the impact of model improvements on enterprise growth. He highlights the importance of flexibility in compute usage across different chip platforms and the company's commitment to responsible AI development.
Summary
In this discussion, Krishna Rao, CFO of Anthropic, illuminates the critical role of compute in their business model, calling it the 'lifeblood' of the company. He explains how Anthropic approaches compute procurement strategically, balancing the risk of overspending and underspending while ensuring they remain at the cutting edge of AI technology. Rao notes that they use a flexible approach by leveraging multiple chip platforms, including Amazon's Tranium, Google's TPUs, and Nvidia's GPUs, to maximize compute efficiency and value. The conversation also delves into their internal culture of collaboration, openness, and the importance of safety and alignment in AI development. Further, Rao discusses the transformational potential of AI in sectors like healthcare and biotechnology, reflecting on how ongoing model improvements lead to significant growth and returns on investment. He concludes with insights about investor perceptions and the evolving landscape of AI regulation.
About this episode
In this episode of Invest Like The Best, Patrick O'Shaughnessy sits down with Anthropic CFO Krishna Rao for a fascinating look inside one of the fastest-growing AI companies in the world. Krishna reveals what it takes to manage the lifeblood of generative AI: compute. From procuring gigawatts of processing power across Amazon, Google, and Nvidia, to dynamically allocating it for model training and customer demand, compute dictates Anthropic's future. They explore the company's mind-bending exponential revenue growth, the "cone of uncertainty" in forecasting, and why frontier AI models continue to defy scaling limits. Krishna also shares how Claude is revolutionizing his own internal finance team, Anthropic's unique culture of safety and transparency, and his bold predictions for AI-driven breakthroughs in healthcare. #Anthropic #AI #ArtificialIntelligence #Investing #Technology #Claude #Compute #MachineLearning #VentureCapital #Finance Timestamps: 0:00 Intro 2:38 The Compute Canvas 6:51 The "Cone of Uncertainty" in AI Growth 11:58 Why the Returns to Frontier Intelligence Are So High 16:45 Recursive Self-Improvement 20:20 Scaling Laws 23:30 Sourcing $100 Billion in Compute 28:05 Platform vs. Application Strategy 32:52 Pricing Dynamics 38:48 How Anthropic’s Finance Team Uses Claude 43:24 Raising Capital & Overcoming Investor Skepticism 52:32 Public Perception, Risks, and Government Regulation 57:25 Mythos 1:12:33 What Could Derail the AI Revolution? 1:13:47 Biotech and Healthcare 1:15:31 The Kindest Thing Presented by Ramp: https://ramp.com/invest Sponsored by Vanta, WorkOS, Rogo, and Ridgeline: https://www.vanta.com/invest https://workos.com/ https://rogo.ai/invest https://www.ridgelineapps.com/ ****** Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests are solely their own and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc
Key Insights
- Krishna Rao emphasizes that compute is the lifeblood of Anthropic, crucial for the company's operations and model development.
- He discusses the challenges of compute procurement, highlighting a delicate balance between buying too much and too little.
- Rao indicates that flexibility in compute utilization is key, allowing Anthropic to adapt to varying workloads across different chip platforms.
- He mentions that they spend 30-40% of their time managing compute resources, underscoring its importance in decision-making.
- Rao outlines a cone of uncertainty approach in predicting demand for compute, emphasizing the need for flexible planning.
- He believes that the returns from frontier intelligence become exceedingly profitable, particularly in enterprise contexts.
- Rao asserts that offering cutting-edge models leads to substantial revenue growth and expanded total addressable market (TAM).
- He notes that AI advancements enable significant productivity increases in sectors like healthcare and biotechnology.
- Rao explains that the safety and interpretability of models can enhance enterprise trust and customer relations.
- He conveys that Anthropic positions its research and AI practices to balance innovation with responsible deployment.
- Rao outlines the company's collaborative culture, valuing transparency and rigorous debate among team members.
- He emphasizes the importance of hiring great partners within the company to foster a productive and innovative environment.
Topics
Transcript
[0:00] Every time we have a new model, there's a set of capabilities that are different. People tend to think about model intelligence as IQ. We think of it kind of differently. Intelligence for us is multi-dimensional. It's not just a score. What is the realworld capability of this model? Each model generation gives you the chance to do more with it, to do it better, to do it more efficiently because we think the returns to frontier intelligence are extremely high. And it's extremely high especially in enterprise. That's a core thesis of our business. [0:41] Krishna, I have been so excited for this conversation because you get to see from the inside one of the most interesting businesses…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Invest Like The Best
How Losing Everything Shaped Uber’s CEO
Uber's CEO reflects on his immigrant experience, describing how his family lost everything after coming from Iran and how that hardship shaped his drive to rebuild. He credits life's challenges as formative experiences that provide profound human satisfaction when overcome. He emphasizes a stable, grounded sense of self as his anchor against external chaos.
Why Uber's Future is Autonomous
Uber is positioning itself as the dominant aggregator of autonomous vehicle supply by partnering with major AV providers. The company is building ecosystem infrastructure and collecting real-world street data to accelerate AV deployment and capture instant demand when vehicles hit new markets.
Why the AI Boom Is Just Getting Started
Investor Alex from Whale Rock Capital discusses their high-conviction investment in Anthropic, explaining why AI represents an unprecedented 'L-curve' of adoption rather than a typical S-curve. He outlines their framework of S-curves, competitive advantages, and underappreciated earnings power, while detailing the decommoditization of hardware infrastructure and concerns about traditional enterprise software companies.
Uber CEO on AI, Autonomous Vehicles, and the Future of Transportation
Uber CEO Dara Khosrowshahi discusses his journey from Expedia to leading Uber through chaos, the company's AI and autonomous vehicle strategy, and his personal philosophy on leadership and resilience. He covers Uber's expansion into hotels, membership programs, and the physical AI opportunity, while reflecting on mentors like Barry Diller and the lessons from his immigrant upbringing.
30 Years of Finding Alpha | Dan Loeb
Dan Loeb, founder of Third Point, reflects on 30 years of investing across credit, equities, and activism, discussing his evolution from event-driven deep value to quality growth investing. He shares views on AI's transformative impact on markets and portfolio construction, governance lessons from activism campaigns, and insights on the future role of human capital allocators in an increasingly AI-driven world.