Can Cloudflare save the web from AI?
Matthew Prince, CEO of Cloudflare, discusses how AI is fundamentally changing the internet's business model from advertising to micropayments for data access. He also explains Cloudflare's decision to lay off 20% of its workforce by automating measurement and middle-management functions, using AI to better identify talent and flatten organizational structures.
Summary
In this extended conversation, Matthew Prince outlines two major shifts happening at Cloudflare and the internet broadly. First, automated traffic from AI bots now exceeds human traffic on the internet and is projected to be 1,000 times larger than human traffic within five years. This creates an infrastructure cost problem because traditional advertising doesn't work for bots. Prince proposes reviving the HTTP 402 payment protocol to enable micropayments, where AI companies would pay small fractions of pennies to access content, similar to how Spotify pays musicians. He argues this could incentivize new content creation, particularly in areas where AI models have knowledge gaps—calling these 'holes in the Swiss cheese' of AI knowledge. The model resembles Spotify's music ecosystem, where $12 billion flows annually to creators, though he acknowledges the transition will create winners and losers.
Prince discusses how local news and unique content become more valuable in this future because AI companies need novel information their models lack. He references his own small local newspaper in Park City, Utah potentially earning more from AI licensing deals than digital advertising. He also advocates for recognizing content creators through awards systems similar to the Nobel Prize, since the financial mechanism alone may not sufficiently incentivize contribution.
Regarding Cloudflare's ability to block AI scrapers, Prince explains that Cloudflare controls over 20% of internet infrastructure, giving it significant leverage to set defaults that require payment for AI training access. He describes negotiations with Google, noting they were initially resistant but are now committing to transparency about their crawler and allowing publishers to opt out of AI training.
On the structural side, Prince details how Cloudflare laid off 1,100 employees (20% of workforce) in May 2025, a decision he publicly justified in a Wall Street Journal op-ed. He categorizes organizational functions as builders (engineers, product managers), sellers (sales teams), and measurers (auditors, some middle management). AI dramatically improved measurement functions—he cites an example where a 20-person team spending two weeks on investor relations documents was replaced with a 3-minute process using AI. Rather than just cut these roles, Cloudflare flattened the organization, increasing manager span of control from 8 to 12 direct reports and using AI to identify rising talent across the company by analyzing code commits, collaboration patterns, and outcomes.
Prince argues this approach is actually more humane than delaying layoffs until industry-wide adoption makes re-employment harder. He emphasizes he's hiring more builders and sellers than ever because their increased productivity (10x) makes them more valuable investments. He acknowledges risks of over-reliance on AI measurement systems but argues uncorrelated AI biases can actually improve decision-making compared to human organizational biases.
On content moderation, Prince reflects on Cloudflare's previous decisions to deplatform Stormfront and the Daily Stormer. He acknowledges using those controversies as means to an end—to shape policy discussions—rather than as inherent goods. He suggests that future decisions would differ because the context has changed, but that addressing root business model problems (moving from attention-based to knowledge-based incentives) may be more effective long-term than individual deplatforming decisions.
About this episode
Cloudflare discovered in June that bots already make up more than half of internet traffic — and CEO Matthew Prince says that bots could outnumber humans a thousand to one within five years. That's a huge change to the internet, and if the web is going to keep existing, it needs a huge change to its business model. Can Cloudflare use its place in the ecosystem to direct the money back to the people who make content? Links: How I choose which Cloudflare employees to replace with AI | Wall Street Journal Why Cloudflare CEO Matthew Prince is the internet’s unlikely defender | Decoder (2024) Cloudflare will now block AI crawlers by default | The Verge Patreon partners with Cloudflare to block AI crawlers | 404 Media Sony and Warner sue Anthropic in latest AI music lawsuit | Billboard Trump administration supports OpenAI in NYT copyright lawsuit | The Verge Google Zero is here — now what? | The Verge (2024) Subscribe to The Verge to access the ad-free version of Decoder! Credits: Decoder is a production of The Verge and part of the Vox Media Podcast Network. Decoder’s producers are Greg Ott, Kate Cox, and Nick Statt. This episode was edited by Kabir Chopra. Our editorial director is Kevin McShane. The Decoder music is by Breakmaster Cylinder. Learn more about your ad choices. Visit podcastchoices.com/adchoices
Key Insights
- Automated traffic is projected to reach 1,000 times human traffic within five years, creating infrastructure costs that advertising cannot solve, necessitating a new payment mechanism for bot access to content.
- Cloudflare discovered that micropayments through a revived HTTP 402 protocol could work similarly to Spotify's music streaming model, where AI companies pay fractions of pennies per access, redistributing funds to content creators.
- AI companies explicitly seek 'holes in the Swiss cheese' of AI knowledge—novel information their models lack—making local news and unique original content more economically valuable than generic reporting.
- Reddit's content commands higher licensing fees than The New York Times' in AI deals because Reddit is irreplaceable and unique, while major news outlets are substitutable by competitors.
- Cloudflare controls over 20% of global internet infrastructure, giving it sufficient leverage to set payment defaults for AI training access that major AI companies have shown willingness to accept.
- Cloudflare's layoff strategy categorized all organization functions into builders (engineers), sellers (sales), and measurers (auditors/middle management), with AI most effectively automating the measurement category.
- A 20-person investor relations team that took two weeks to prepare earnings documents was replaced with a 3-minute AI process that produced fewer errors and higher-quality outputs.
- Cloudflare increased manager span of control from eight to twelve direct reports using AI tools to surface issues early, simultaneously flattening organizational hierarchy and improving manager effectiveness.
- AI biases, though present, are uncorrelated to human organizational biases, making AI systems valuable for identifying overlooked talent and decisions that human-biased groups would systematically miss.
- Earlier adoption of AI-driven layoffs, while costly in terms of public backlash, is more humane than delaying until industry-wide adoption makes re-employment harder for affected workers.
- The shift from attention-based to knowledge-based economic incentives in the internet could reduce incentives for rage-baiting and inflammatory content, addressing root causes rather than symptoms of harmful speech.
- Cloudflare's previous deplatforming decisions (Daily Stormer, Stormfront) served as policy advocacy tools rather than inherent moral goods, and future decisions would differ based on changed contextual circumstances.
Topics
Transcript
Support for the show comes from EY. AI is reshaping how enterprises operate, compete, and create value. But organizations are struggling to move beyond fragmented tools and siloed AI investments to create real impact. EY.AI, the reimagination engine, is an open, dynamic, AI-led technology system at the heart of EY. By combining AI, technology, and people with trusted experience, EY helps organizations turn AI ambition into enterprise value. Because AI is only as valuable as the hands that shape it. Go to ey.ai to explore more. Hello and welcome to Decoder. I'm Neil I. Patel, Editor-in-Chief of The Verge, and Decoder is my show about big ideas and other problems. This episode is part of a two-part series on the…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Decoder with Nilay Patel
The hidden supply chain costs of the AI boom
Economist Willie Shi discusses why global supply chains remain resilient despite tariffs and trade barriers, arguing that market forces and first-principles economics drive supply chain organization more than policy interventions. He contends that reshoring manufacturing to the US without understanding labor productivity and technological differentiation is unlikely to succeed, and that strategic trade within allied nations offers better economic outcomes than protectionist policies.
Kevin Roose is AGI-pilled. Why aren't you?
Kevin Roose discusses his new book "The AGI Chronicles" and his transition from The New York Times to co-founding the podcast "Machine Gods" with Casey Newton. He explores the culture and dynamics of AI frontier labs, their belief in AGI inevitability, and the gap between idealistic technical leaders and the business realities of scaling AI companies.
JB Pritzker thinks AI could help us live to 100 — or threaten us like nukes
Illinois Governor J.B. Pritzker discusses AI regulation, privacy concerns, and the political realignment around tech policy during his re-election campaign. He emphasizes government's role in protecting citizens from corporate overreach while acknowledging the challenges of regulating rapidly evolving technology, drawing parallels to nuclear weapons as an existential concern requiring collective action.
Why Elon Musk wants to sell you cell service
SpaceX is aggressively entering the wireless carrier market by acquiring low-band spectrum and planning to build a terrestrial network alongside its satellite constellation. Analyst Walter Pysyk argues that existing carriers like Verizon are poorly positioned to compete and have misread the competitive threat, while SpaceX's execution track record suggests the company can overcome the traditionally expensive and complex telecom business.
Benn Jordan thinks the surveillance problem is much bigger than Flock
Ben Jordan, a musician and investigative journalist, discusses his work exposing security vulnerabilities in Flock's automatic license plate reader system and the broader surveillance infrastructure. He explains how a startup's defensive PR strategy made it a target while larger contractors quietly built similar networks, and argues that the real problem lies in government oversight failures rather than any single company.