Can Cloudflare save the web from AI?
Matthew Prince, CEO of Cloudflare, discusses how AI is fundamentally changing the internet's business model from advertising to micropayments for data access. He also explains Cloudflare's decision to lay off 20% of its workforce by automating measurement and middle-management functions, using AI to better identify talent and flatten organizational structures.
Summary
In this extended conversation, Matthew Prince outlines two major shifts happening at Cloudflare and the internet broadly. First, automated traffic from AI bots now exceeds human traffic on the internet and is projected to be 1,000 times larger than human traffic within five years. This creates an infrastructure cost problem because traditional advertising doesn't work for bots. Prince proposes reviving the HTTP 402 payment protocol to enable micropayments, where AI companies would pay small fractions of pennies to access content, similar to how Spotify pays musicians. He argues this could incentivize new content creation, particularly in areas where AI models have knowledge gaps—calling these 'holes in the Swiss cheese' of AI knowledge. The model resembles Spotify's music ecosystem, where $12 billion flows annually to creators, though he acknowledges the transition will create winners and losers.
Prince discusses how local news and unique content become more valuable in this future because AI companies need novel information their models lack. He references his own small local newspaper in Park City, Utah potentially earning more from AI licensing deals than digital advertising. He also advocates for recognizing content creators through awards systems similar to the Nobel Prize, since the financial mechanism alone may not sufficiently incentivize contribution.
Regarding Cloudflare's ability to block AI scrapers, Prince explains that Cloudflare controls over 20% of internet infrastructure, giving it significant leverage to set defaults that require payment for AI training access. He describes negotiations with Google, noting they were initially resistant but are now committing to transparency about their crawler and allowing publishers to opt out of AI training.
On the structural side, Prince details how Cloudflare laid off 1,100 employees (20% of workforce) in May 2025, a decision he publicly justified in a Wall Street Journal op-ed. He categorizes organizational functions as builders (engineers, product managers), sellers (sales teams), and measurers (auditors, some middle management). AI dramatically improved measurement functions—he cites an example where a 20-person team spending two weeks on investor relations documents was replaced with a 3-minute process using AI. Rather than just cut these roles, Cloudflare flattened the organization, increasing manager span of control from 8 to 12 direct reports and using AI to identify rising talent across the company by analyzing code commits, collaboration patterns, and outcomes.
Prince argues this approach is actually more humane than delaying layoffs until industry-wide adoption makes re-employment harder. He emphasizes he's hiring more builders and sellers than ever because their increased productivity (10x) makes them more valuable investments. He acknowledges risks of over-reliance on AI measurement systems but argues uncorrelated AI biases can actually improve decision-making compared to human organizational biases.
On content moderation, Prince reflects on Cloudflare's previous decisions to deplatform Stormfront and the Daily Stormer. He acknowledges using those controversies as means to an end—to shape policy discussions—rather than as inherent goods. He suggests that future decisions would differ because the context has changed, but that addressing root business model problems (moving from attention-based to knowledge-based incentives) may be more effective long-term than individual deplatforming decisions.
About this episode
Cloudflare discovered in June that bots already make up more than half of internet traffic — and CEO Matthew Prince says that bots could outnumber humans a thousand to one within five years. That's a huge change to the internet, and if the web is going to keep existing, it needs a huge change to its business model. Can Cloudflare use its place in the ecosystem to direct the money back to the people who make content? Links: How I choose which Cloudflare employees to replace with AI | Wall Street Journal Why Cloudflare CEO Matthew Prince is the internet’s unlikely defender | Decoder (2024) Cloudflare will now block AI crawlers by default | The Verge Patreon partners with Cloudflare to block AI crawlers | 404 Media Sony and Warner sue Anthropic in latest AI music lawsuit | Billboard Trump administration supports OpenAI in NYT copyright lawsuit | The Verge Google Zero is here — now what? | The Verge (2024) Subscribe to The Verge to access the ad-free version of Decoder! Credits: Decoder is a production of The Verge and part of the Vox Media Podcast Network. Decoder’s producers are Greg Ott, Kate Cox, and Nick Statt. This episode was edited by Kabir Chopra. Our editorial director is Kevin McShane. The Decoder music is by Breakmaster Cylinder. Learn more about your ad choices. Visit podcastchoices.com/adchoices
Key Insights
- Automated traffic is projected to reach 1,000 times human traffic within five years, creating infrastructure costs that advertising cannot solve, necessitating a new payment mechanism for bot access to content.
- Cloudflare discovered that micropayments through a revived HTTP 402 protocol could work similarly to Spotify's music streaming model, where AI companies pay fractions of pennies per access, redistributing funds to content creators.
- AI companies explicitly seek 'holes in the Swiss cheese' of AI knowledge—novel information their models lack—making local news and unique original content more economically valuable than generic reporting.
- Reddit's content commands higher licensing fees than The New York Times' in AI deals because Reddit is irreplaceable and unique, while major news outlets are substitutable by competitors.
- Cloudflare controls over 20% of global internet infrastructure, giving it sufficient leverage to set payment defaults for AI training access that major AI companies have shown willingness to accept.
- Cloudflare's layoff strategy categorized all organization functions into builders (engineers), sellers (sales), and measurers (auditors/middle management), with AI most effectively automating the measurement category.
- A 20-person investor relations team that took two weeks to prepare earnings documents was replaced with a 3-minute AI process that produced fewer errors and higher-quality outputs.
- Cloudflare increased manager span of control from eight to twelve direct reports using AI tools to surface issues early, simultaneously flattening organizational hierarchy and improving manager effectiveness.
- AI biases, though present, are uncorrelated to human organizational biases, making AI systems valuable for identifying overlooked talent and decisions that human-biased groups would systematically miss.
- Earlier adoption of AI-driven layoffs, while costly in terms of public backlash, is more humane than delaying until industry-wide adoption makes re-employment harder for affected workers.
- The shift from attention-based to knowledge-based economic incentives in the internet could reduce incentives for rage-baiting and inflammatory content, addressing root causes rather than symptoms of harmful speech.
- Cloudflare's previous deplatforming decisions (Daily Stormer, Stormfront) served as policy advocacy tools rather than inherent moral goods, and future decisions would differ based on changed contextual circumstances.
Topics
Transcript
Support for the show comes from EY. AI is reshaping how enterprises operate, compete, and create value. But organizations are struggling to move beyond fragmented tools and siloed AI investments to create real impact. EY.AI, the reimagination engine, is an open, dynamic, AI-led technology system at the heart of EY. By combining AI, technology, and people with trusted experience, EY helps organizations turn AI ambition into enterprise value. Because AI is only as valuable as the hands that shape it. Go to ey.ai to explore more. Hello and welcome to Decoder. I'm Neil I. Patel, Editor-in-Chief of The Verge, and Decoder is my show about big ideas and other problems. This episode is part of a two-part series on the…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Decoder with Nilay Patel
I have some questions for Mark Zuckerberg
Nilay Patel analyzes Mark Zuckerberg's recent interview about Meta's AI agent Muse, Meta Glasses, teen safety, and AI data centers, identifying gaps and inconsistencies in Zuckerberg's arguments, particularly around surveillance, regulation, and market forces across different product categories.
Can John Ternus find Apple's next big thing?
Bloomberg's Mark Gurman discusses Apple's leadership transition from Tim Cook to John Ternus, the company's massive executive overhaul, and its strategic positioning in the AI era. He details upcoming product launches including smart home devices, smart glasses, and AirPods with cameras, while analyzing Apple's challenges in competing at the AI frontier.
Does AI need an antitrust exemption so it doesn't kill everyone????
Jonathan Kantor, former DOJ Antitrust Chief, discusses why AI companies don't need antitrust exemptions to address safety concerns, arguing that product liability frameworks and existing competition laws are sufficient. He critiques the framing of China as justification for domestic monopolies and emphasizes that innovation and safety are compatible goals that don't require companies to coordinate on slowing development.
Microsoft AI CEO says AI threats are real, and Anthropic is making it worse
Mustafa Suleiman, CEO of Microsoft AI, discusses AI safety, alignment, and regulation in detail, arguing that alignment alone is insufficient and must be paired with containment mechanisms. He critiques Anthropic's approach to model welfare and consciousness, claiming it makes safety harder, and calls for industry coordination on specific safety standards rather than vague calls to 'slow down.'
Adam Conover explains how YouTube ruined everything
Adam Conover discusses how YouTube has become a powerful gatekeeper over entertainment by capturing TV formats that traditional media abandoned while chasing Netflix, arguing that the platform's algorithm-driven model is actually more restrictive than old broadcast gatekeepers despite claims of democratization. He explains how the collapse of cable economics destroyed the middle class of creative workers and union jobs, forcing creators to become entrepreneurs managing solo operations or small teams dependent on unpredictable brand deals.