20VC: How to Build Your Own Data Center & Why Every Startup Should Do It | How ElevenLabs Leapfrogged Us: What I Learned | The AI Talent War: How Your Hiring Process Needs to Change with Cliff Weitzman, Speechify
Cliff Weitzman, CEO of Speechify, discusses why his company invested tens of millions in NVIDIA GPUs rather than renting, details the economics of GPU ownership vs. cloud computing, and reflects on strategic mistakes like not pursuing B2B earlier while competing with companies like Eleven Labs in the AI space.
Summary
Cliff Weitzman joins Harry Stebbings for an in-depth discussion on Speechify's infrastructure strategy and business positioning in the AI market. The conversation begins with Weitzman explaining the rationale behind Speechify's significant GPU purchases. He argues that owning GPUs makes financial sense because renting costs approximately 1.5x the annual purchase price, and ownership enables engineers to freely experiment without worrying about costs—removing psychological barriers to innovation. Weitzman describes practical challenges of GPU ownership including chip procurement logistics, dealing with vendors like Dell in France, negotiating early delivery premiums of $100k per GPU, arranging specialized cooling systems, managing insurance for high-value freight, and ensuring proper data center infrastructure.
Weitzman addresses concerns about chip depreciation and technological obsolescence by noting that Speechify uses older GPUs for inference tasks and maintains heterogeneous clusters, allowing older hardware to remain productive. He emphasizes that GPU economics work differently than consumer electronics because all GPUs in a cluster are utilized simultaneously, unlike personal computers. He cites NVIDIA's recent deal with Blackstone, BlackRock, and Goldman Sachs to underwrite GPU valuations as evidence of a maturing secondary market creating a floor for asset value.
The discussion pivots to Speechify's strategic missteps, particularly Weitzman's decision not to pursue B2B business aggressively while Eleven Labs and Sierra capitalized on enterprise markets. Weitzman admits this was "the biggest strategic mistake in the history of Speechify," driven by his incorrect belief that text-to-speech APIs would commoditize. He explains how Eleven Labs leapfrogged Speechify by understanding that APIs serve as wedges for continuous innovation into adjacent products like voice cloning, emotional prosody, duplex models, and AI agents—not terminal products.
Weitzman and Stebbings debate whether it's strategically sound for Speechify to enter B2B, given competition from Eleven Labs (backed by government partnerships) and Sierra (led by Brett Taylor with an exceptional executive pedigree). Weitzman argues that market size is large enough for multiple winners and that the company must compete across both B2C and B2B because it has excess engineering capacity and capital. He positions Speechify's B2B offering around a superior API product: better quality, faster speed, and 10x cheaper than alternatives.
The conversation covers AI development practices at Speechify, including how the company evaluates engineers not on token usage leaderboards but on shipped, production-ready features with actual user adoption. Weitzman describes forcing platform teams to adopt AI-assisted development through inspiration and demonstration rather than mandates. He advocates hiring for raw technical intelligence and slope (trajectory) rather than current capability, citing the ability of AI to rapidly upskill talented individuals.
Weitzman discusses hiring challenges in the AI era, pushing back against the notion that it's universally harder. He argues that seed-stage companies benefit from AI-enabled productivity, making the talent pool larger than before, while growth-stage companies compete harder against giants offering $15+ million compensation packages. He mentions that Speechify hires many CTOs from other companies and prioritizes functional interviews and code base assessments.
The discussion addresses market commoditization, particularly in speech-to-text (Whisperflow and Willow) and customer support AI agents (Sierra, Dacagon). Weitzman argues that Speechify's core B2B value proposition differs from customer support competitors—it's API-first, not agent-first, competing in a smaller but less saturated market against Eleven Labs, Gemini, and others. He notes that even as customer support AI saturates with 18+ companies raising $100M+ in 18 months, the API market remains less competitive.
The conversation concludes with Weitzman expressing excitement about AI applications in pharmacology and biology. He describes personal projects using GPU clusters to analyze his brother's genomic and proteomic data to address a rare autoimmune disease, and his plan to sequence genomes of disease patients to identify epigenetic patterns. He argues that AI solves rare disease problems previously considered economically unviable, representing the most important application of compute resources. Weitzman contextualizes this work within his personal journey from dyslexia to founding Speechify, framing the company as a tool for solving human problems through technology.
About this episode
<p>Cliff Weitzman is the co-founder and CEO of Speechify, the world's leading AI voice and text-to-speech platform, used by more than 60 million people globally. Diagnosed with dyslexia as a child, Cliff first built Speechify at Brown University to help him consume written material through audio. </p> <p>AGENDA: </p> <p>00:00 Cliff Weitzman Reveals His Biggest-Ever Strategic Mistake<br /> 03:08 Why Speechify Is Paying Millions to Build Their Own Data Centres<br /> 09:59 What No One Knows About Buying Chips That Everyone Should Know?<br /> 20:19 The AI Data Gold Rush Has a Brutal Business-Model Problem<br /> 23:42 How ElevenLabs Leapfrogged Speechify—and Why It Was Cliff's Fault<br /> 31:00 The $15M AI Talent War: Can Startups Still Compete for the Best Talent?<br /> 36:57 The New 10X Engineer: Ten Killer Decisions Every Day<br /> 46:12 The Voice-AI Bloodbath: Who Survives Commoditisation?<br /> 53:21 The Screen Is Dying—and Voice Will Replace It<br /> 57:58 How Cliff Plans to Use AI to Cure His Brother's Disease</p>
Key Insights
- Weitzman argues that renting GPUs from cloud providers costs approximately 1.5x the annual purchase price, making ownership economically rational over multi-year horizons, particularly for companies with consistent compute demand.
- He explains that GPU ownership solved a critical innovation problem: engineers stopped over-analyzing costs and could freely experiment, removing psychological friction from development velocity.
- Weitzman claims that co-located GPU clusters with high-bandwidth memory interconnects are impossible to achieve through cloud rental, requiring hardware ownership for the scale of training Speechify performs.
- He contends that NVIDIA's new underwriting deal with major financial institutions creates a liquid secondary market for GPUs, establishing a durable price floor that reduces depreciation risk for buyers.
- Weitzman admits his biggest strategic error was believing that text-to-speech APIs would commoditize, causing him to miss the B2B opportunity that Eleven Labs captured through continuous product innovation into adjacent domains.
- He argues that successful AI companies use initial products as wedges to establish user bases, then layer additional innovations (voice cloning, emotional prosody, duplex models, agents) rather than treating first products as terminal offerings.
- Weitzman claims that for growth-stage companies, hiring exceptional talent is significantly harder due to massive compensation packages ($15M+ annually) from frontier labs like OpenAI and Anthropic, while seed-stage hiring is easier than historical norms due to AI-enabled productivity.
- He asserts that the customer support AI market is oversaturated with 18+ companies raising $100M+ in recent months, making it an unattractive competitive space compared to less-crowded API markets.
- Weitzman argues that founder-led companies command massive valuation premiums—citing that removing Elon Musk from Tesla/SpaceX would lose 70% of value, while Meta would maintain or gain value without Mark Zuckerberg, reflecting differences in founder dependency.
- He describes evaluating engineers on shipped, production-ready features with actual user adoption rather than token usage metrics, positioning applied AI development over theoretical optimization.
- Weitzman contends that AI enables hiring for slope (trajectory/potential) over intercept (current capability), as AI tools can rapidly upskill talented individuals in domains where they lack experience.
- He claims that AI applications in rare disease research by combining GPU clusters with genomic/proteomic data analysis can solve problems previously considered economically unviable, representing the highest-impact use of compute resources.
Topics
Transcript
100% is on. It's the biggest strategic mistake I made in the history of Speechify. The best way to lose is not to be in the race. Be in the race. You don't want to be a fat manager who's like a general sitting in the back saying, take that hill. You want to be the warrior who runs up with their sword and engages the enemy first. This is 20VC with me, Harry Stebbings. Now, I am fed up of the simple question-answer, back-and-forth podcast. Today is a real frickin' discussion. Cliff Weitzman, founder and CEO at Speechify, one of the fastest growing text-to-speech startups in the world, on the show where we have a real debate about whether…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: NVIDIA Crushes Quarter and Buys Hugging Face | OpenAI Cuts Off Cursor | Instinct Hits $2.5BN Valuation and The Race for AI Assistants | Cognition Raises at $46BN, Linear $2.5BN and Clay $7BN
In this 20VC episode, investors Rory Driscoll and Jason Lampkin discuss NVIDIA's record $96B quarter and $12.9B Hugging Face acquisition, OpenAI cutting off Cursor amid founder tensions, the OpenAI-Hugging Face agent security incident, and rising valuations for AI assistant startups like Instinct ($2.5B), Cognition ($46B), Linear ($2.5B), and Clay ($7B). The core theme is that AI is enabling 'compound startups' building 100x more software at unprecedented speed, fundamentally reshaping venture capital allocation and competitive dynamics.
20VC: The AI Bubble Is Wrong | AI Margins Need to Improve | Revenue Concentration Should be a Concern | Why People Over-Estimate Open Models But Enterprises Still Fear Frontier Models with Aaron Katz, ClickHouse
Aaron Katz, CEO of ClickHouse, discusses the unprecedented pace of AI-driven growth, the company's path to $1B ARR, and how agent-centric design is reshaping infrastructure software. He argues that frontier models will dominate enterprise adoption due to security concerns, while open-source software remains critical despite open-weight model proliferation.
20VC: Is Anthropic's Coding Business Worth $2 Trillion? | Should American Enterprises Work With Open-Source Chinese Models? | Why 80–90% of Neo-Labs Die in the Next 18 Months? with Eno Reyes, Co-Founder @ Factory
Eno Reyes, CTO and co-founder of Factory, discusses how the smartest AI models will become the cheapest when measured by outcomes rather than token costs, predicts 80-90% of AI neo-labs will fail within 18 months, and argues that 99% of workflows will run on open-source models within three years while frontier models capture only 1% of usage but 30-40% of economic value.
20VC: NVIDIA Bonanza: Buys Poolside & Invests in Mercor and Perplexity | Anthropic's $30TRN Revenue Assumption & OpenAI Confirms IPO | Why Customer Service, Defence and Robotics are Overinflated
In this 20VC episode, Jason Lemkin, Rory O'Driscoll, and Harry Stebbings discuss major AI industry developments including NVIDIA's $12B Poolside acquisition, OpenAI's 2027 IPO announcement, and Anthropic's growing dominance. They analyze whether current valuations and market dynamics are sustainable, debating the emerging 'token addiction' in enterprises and which AI investment categories are overheated.
20VC: Inside Sequoia's Investment Committee: Lessons from Don Valentine, Doug Leone and Alfred Lin | How the SpaceX and Citadel Deals Went Down | What Sequoia Specifically Looks for in Founders with Julien Bek
Julien Bek, a Sequoia partner, discusses how Sequoia identifies and invests in exceptional founders and companies, emphasizing that everyone at the firm is a 'hunter' rather than waiting passively for deals. He explores the shift from co-pilot to autopilot AI applications, the emerging 'services economy' as a trillion-dollar opportunity, and how to read founders through vulnerability, references, and understanding their trajectory rather than pattern matching.