OpinionInsightful

Most Replayed Moment: How AI Companies Are Gaslighting You - Karen Hao

The Diary Of A CEO with Steven Bartlett24m 8s

Journalist Karen Hao discusses how AI company leaders' public statements have evolved to align with their business incentives, arguing that companies like OpenAI operate as "empires" that exploit resources, labor, and knowledge while using existential risk narratives to justify undemocratic development. She details how these companies suppress critical research and use access to journalists as a tool for controlling their public image.

Summary

Karen Hao analyzes how AI leaders' quotes have shifted over time based on their financial incentives. She references Dario Amodei's 2017 statement putting the risk of catastrophic AI outcomes at 10-25%, and Ilya Sutskever's 2019 comparison of future human-AI relationships to how humans treat animals—potentially disregarding human interests when convenient. Hao explains that these leaders operate from a specific hypothesis that brains are statistical engines, leading them to believe that larger statistical models will inevitably become superintelligent, a theory that remains scientifically unproven and debated.

Hao frames AI companies as modern empires that parallel historical empires through four mechanisms: (1) seizing resources not rightfully theirs, including personal data and artists' intellectual property; (2) exploiting massive amounts of global labor; (3) monopolizing knowledge production through controlling AI research funding and censoring inconvenient findings; and (4) employing a narrative claiming they are benevolent forces preventing worse outcomes from evil competitors (initially Google, now China).

She provides the example of Dr. Timnit Gebru, who was hired at Google to critique AI systems but was fired after publishing critical research on large language models' harmful outcomes. Hao also describes how OpenAI allegedly subpoenaed a nonprofit watchdog director during its nonprofit-to-for-profit conversion, attempting to intimidate critics. She details how OpenAI initially agreed to participate in her book but withdrew cooperation after the board fired Sam Altman, refusing to respond to 40 pages of requests for comment.

Hao argues that access control is a key tactic these companies use to manage journalists and prevent critical coverage. She notes that companies dangle interview opportunities to influence journalistic behavior and discourage coverage of critics. She reflects on how losing access to OpenAI early in her career forced her to develop independent reporting capabilities, ultimately enabling her to conduct 300+ interviews without company cooperation.

About this episode

What if the biggest risk from AI isn’t the technology itself - but who controls it? Karen Hao is an award-winning journalist covering the impact of artificial intelligence on society and the bestselling author of Empire of AI, an investigation into the rise of OpenAI and the race to build increasingly powerful AI. In this moment, Karen Hao examines the assumptions driving the race towards AGI and asks why building technology that can replicate human capabilities became the goal in the first place. She explores the enormous resources behind that ambition, and the relationship between AI companies and the researchers and journalists scrutinising them. Listen to the full episode here! Spotify: https://g2ul0.app.link/c6dLG2e595b Apple: https://g2ul0.app.link/5tusFIE595b Watch the Episodes On YouTube: https://www.youtube.com/c/%20TheDiaryOfACEO/videos Karen Hao: https://karendhao.com/

Key Insights

  • AI leaders' public statements about existential risk and AGI timelines have evolved to match their financial incentives and company positioning, with earlier warnings about catastrophic outcomes (10-25% probability) now paired with promises of utopian benefits to justify concentrated control of AI development.
  • The core hypothesis driving AI development—that brains are statistical engines and larger statistical models will become superintelligent—is an unproven scientific hypothesis specific to certain researchers like Ilya Sutskever and Jeffrey Hinton, not established scientific fact, yet it shapes billion-dollar development strategies with global consequences.
  • AI companies suppress critical research through both funding control (directing research money only toward priorities aligned with company goals) and direct censorship, exemplified by Google firing researchers Timnit Gebru and Margaret Mitchell after they published findings showing harmful outcomes of large language models.
  • Access to company representatives has become a tool for controlling journalist behavior and suppressing critical coverage, with companies strategically dangling interview opportunities to discourage journalists from covering critics or publishing unfavorable stories.
  • The narrative framework used by AI companies mirrors historical empires by claiming benevolence and necessity (framing themselves as protecting humanity from worse competitors like China or Google) to justify otherwise exploitative practices like data seizure, labor exploitation, and resource monopolization.

Topics

AI company leadership rhetoric and incentive alignmentScientific hypotheses underlying AI development strategyAI companies as modern empiresKnowledge monopolization and research suppressionControl of media access and journalismLabor exploitation in AI developmentData and intellectual property seizureExistential risk narratives as justification tool

Transcript

What I found really interesting is to look at how people's quotes evolve over time with their incentives. So I was looking at all of the things they've said on the record on podcasts, in their blog posts, to see how it's evolved over time. And Dario, who was the former VP of Research, OpenAI, and has now moved on to Anthropic, who are taking a slightly different approach to developing AI, said back in 2017, while he was still at OpenAI... that, this is a quote, I think at the extreme end is the Nick Bostrom style of fear that an AGI could destroy humanity. I can't see any reason in principle why that couldn't happen. My chance that…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Diary Of A CEO with Steven Bartlett

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.