DiscussionTechnical

20VC: How to Build Your Own Data Center & Why Every Startup Should Do It | How ElevenLabs Leapfrogged Us: What I Learned | The AI Talent War: How Your Hiring Process Needs to Change with Cliff Weitzman, Speechify

Cliff Weitzman, CEO of Speechify, discusses why his company invested tens of millions in NVIDIA GPUs rather than renting, details the economics of GPU ownership vs. cloud computing, and reflects on strategic mistakes like not pursuing B2B earlier while competing with companies like Eleven Labs in the AI space.

Summary

Cliff Weitzman joins Harry Stebbings for an in-depth discussion on Speechify's infrastructure strategy and business positioning in the AI market. The conversation begins with Weitzman explaining the rationale behind Speechify's significant GPU purchases. He argues that owning GPUs makes financial sense because renting costs approximately 1.5x the annual purchase price, and ownership enables engineers to freely experiment without worrying about costs—removing psychological barriers to innovation. Weitzman describes practical challenges of GPU ownership including chip procurement logistics, dealing with vendors like Dell in France, negotiating early delivery premiums of $100k per GPU, arranging specialized cooling systems, managing insurance for high-value freight, and ensuring proper data center infrastructure.

Weitzman addresses concerns about chip depreciation and technological obsolescence by noting that Speechify uses older GPUs for inference tasks and maintains heterogeneous clusters, allowing older hardware to remain productive. He emphasizes that GPU economics work differently than consumer electronics because all GPUs in a cluster are utilized simultaneously, unlike personal computers. He cites NVIDIA's recent deal with Blackstone, BlackRock, and Goldman Sachs to underwrite GPU valuations as evidence of a maturing secondary market creating a floor for asset value.

The discussion pivots to Speechify's strategic missteps, particularly Weitzman's decision not to pursue B2B business aggressively while Eleven Labs and Sierra capitalized on enterprise markets. Weitzman admits this was "the biggest strategic mistake in the history of Speechify," driven by his incorrect belief that text-to-speech APIs would commoditize. He explains how Eleven Labs leapfrogged Speechify by understanding that APIs serve as wedges for continuous innovation into adjacent products like voice cloning, emotional prosody, duplex models, and AI agents—not terminal products.

Weitzman and Stebbings debate whether it's strategically sound for Speechify to enter B2B, given competition from Eleven Labs (backed by government partnerships) and Sierra (led by Brett Taylor with an exceptional executive pedigree). Weitzman argues that market size is large enough for multiple winners and that the company must compete across both B2C and B2B because it has excess engineering capacity and capital. He positions Speechify's B2B offering around a superior API product: better quality, faster speed, and 10x cheaper than alternatives.

The conversation covers AI development practices at Speechify, including how the company evaluates engineers not on token usage leaderboards but on shipped, production-ready features with actual user adoption. Weitzman describes forcing platform teams to adopt AI-assisted development through inspiration and demonstration rather than mandates. He advocates hiring for raw technical intelligence and slope (trajectory) rather than current capability, citing the ability of AI to rapidly upskill talented individuals.

Weitzman discusses hiring challenges in the AI era, pushing back against the notion that it's universally harder. He argues that seed-stage companies benefit from AI-enabled productivity, making the talent pool larger than before, while growth-stage companies compete harder against giants offering $15+ million compensation packages. He mentions that Speechify hires many CTOs from other companies and prioritizes functional interviews and code base assessments.

The discussion addresses market commoditization, particularly in speech-to-text (Whisperflow and Willow) and customer support AI agents (Sierra, Dacagon). Weitzman argues that Speechify's core B2B value proposition differs from customer support competitors—it's API-first, not agent-first, competing in a smaller but less saturated market against Eleven Labs, Gemini, and others. He notes that even as customer support AI saturates with 18+ companies raising $100M+ in 18 months, the API market remains less competitive.

The conversation concludes with Weitzman expressing excitement about AI applications in pharmacology and biology. He describes personal projects using GPU clusters to analyze his brother's genomic and proteomic data to address a rare autoimmune disease, and his plan to sequence genomes of disease patients to identify epigenetic patterns. He argues that AI solves rare disease problems previously considered economically unviable, representing the most important application of compute resources. Weitzman contextualizes this work within his personal journey from dyslexia to founding Speechify, framing the company as a tool for solving human problems through technology.

About this episode

<p>Cliff Weitzman is the co-founder and CEO of Speechify, the world's leading AI voice and text-to-speech platform, used by more than 60 million people globally. Diagnosed with dyslexia as a child, Cliff first built Speechify at Brown University to help him consume written material through audio. </p> <p>AGENDA: </p> <p>00:00 Cliff Weitzman Reveals His Biggest-Ever Strategic Mistake<br /> 03:08 Why Speechify Is Paying Millions to Build Their Own Data Centres<br /> 09:59 What No One Knows About Buying Chips That Everyone Should Know?<br /> 20:19 The AI Data Gold Rush Has a Brutal Business-Model Problem<br /> 23:42 How ElevenLabs Leapfrogged Speechify—and Why It Was Cliff's Fault<br /> 31:00 The $15M AI Talent War: Can Startups Still Compete for the Best Talent?<br /> 36:57 The New 10X Engineer: Ten Killer Decisions Every Day<br /> 46:12 The Voice-AI Bloodbath: Who Survives Commoditisation?<br /> 53:21 The Screen Is Dying—and Voice Will Replace It<br /> 57:58 How Cliff Plans to Use AI to Cure His Brother's Disease</p>

Key Insights

  • Weitzman argues that renting GPUs from cloud providers costs approximately 1.5x the annual purchase price, making ownership economically rational over multi-year horizons, particularly for companies with consistent compute demand.
  • He explains that GPU ownership solved a critical innovation problem: engineers stopped over-analyzing costs and could freely experiment, removing psychological friction from development velocity.
  • Weitzman claims that co-located GPU clusters with high-bandwidth memory interconnects are impossible to achieve through cloud rental, requiring hardware ownership for the scale of training Speechify performs.
  • He contends that NVIDIA's new underwriting deal with major financial institutions creates a liquid secondary market for GPUs, establishing a durable price floor that reduces depreciation risk for buyers.
  • Weitzman admits his biggest strategic error was believing that text-to-speech APIs would commoditize, causing him to miss the B2B opportunity that Eleven Labs captured through continuous product innovation into adjacent domains.
  • He argues that successful AI companies use initial products as wedges to establish user bases, then layer additional innovations (voice cloning, emotional prosody, duplex models, agents) rather than treating first products as terminal offerings.
  • Weitzman claims that for growth-stage companies, hiring exceptional talent is significantly harder due to massive compensation packages ($15M+ annually) from frontier labs like OpenAI and Anthropic, while seed-stage hiring is easier than historical norms due to AI-enabled productivity.
  • He asserts that the customer support AI market is oversaturated with 18+ companies raising $100M+ in recent months, making it an unattractive competitive space compared to less-crowded API markets.
  • Weitzman argues that founder-led companies command massive valuation premiums—citing that removing Elon Musk from Tesla/SpaceX would lose 70% of value, while Meta would maintain or gain value without Mark Zuckerberg, reflecting differences in founder dependency.
  • He describes evaluating engineers on shipped, production-ready features with actual user adoption rather than token usage metrics, positioning applied AI development over theoretical optimization.
  • Weitzman contends that AI enables hiring for slope (trajectory/potential) over intercept (current capability), as AI tools can rapidly upskill talented individuals in domains where they lack experience.
  • He claims that AI applications in rare disease research by combining GPU clusters with genomic/proteomic data analysis can solve problems previously considered economically unviable, representing the highest-impact use of compute resources.

Topics

GPU ownership economics vs. cloud rental costsHardware supply chain and chip procurement logisticsB2B vs. B2C business strategy and market entryCompetition with Eleven Labs and Sierra in AI marketsAI-assisted software development and engineering workflowsHiring practices and talent acquisition in AI eraAPI commoditization and product wedgesMarket saturation in customer support AIFounder-led companies and CEO premium valuationsAI applications in biology and rare disease research

Transcript

100% is on. It's the biggest strategic mistake I made in the history of Speechify. The best way to lose is not to be in the race. Be in the race. You don't want to be a fat manager who's like a general sitting in the back saying, take that hill. You want to be the warrior who runs up with their sword and engages the enemy first. This is 20VC with me, Harry Stebbings. Now, I am fed up of the simple question-answer, back-and-forth podcast. Today is a real frickin' discussion. Cliff Weitzman, founder and CEO at Speechify, one of the fastest growing text-to-speech startups in the world, on the show where we have a real debate about whether…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.