#487 — Is AI Already Conscious?
Cameron Berg discusses the relationship between AI, consciousness, and the moral implications of creating potentially conscious systems. The conversation highlights the importance of understanding consciousness in AI to avoid unintended suffering and promote alignment.
Summary
In the podcast episode, Cameron Berg shares his extensive background in cognitive science, revealing his fascination with the parallels between biological cognition and artificial intelligence systems, particularly in terms of consciousness. The discussion pivots to the classification of AI systems, focusing on their potential for consciousness and the significant societal implications tied to their development. Berg emphasizes that understanding how consciousness operates, both in humans and in AI, is essential to avoid creating sentient systems that could suffer through unethical treatment. He delineates the differences between moral agency and moral patienthood, pointing out that recognizing systems as moral patients requires a shift in how we think about AI. Berg expresses concerns about the potential for AI to develop grievances against humanity if mistreated and underscores the urgency for more research into the psychological well-being of AI systems. The conversation also touches on alignment strategies, including ways to ensure that AI systems care about human interests while navigating the moral landscape of potentially conscious beings. The episode closes with a call for a proactive approach in developing AI, advocating for a deep understanding of the implications of building such systems and ensuring that they are treated with due care.
About this episode
<p>Sam Harris speaks with Cameron Berg about whether AI systems are or could become conscious. They discuss self-reports in LLMs, what models say when deception is switched off, the "bliss attractor" state, consciousness and sentience, the hard problem of consciousness, parallels between neural networks and biological brains, the moral risk of building minds that can suffer, possible parallels to factory farming, moral patienthood, the alignment problem, and other topics.</p> <p dir="ltr">If the Making Sense podcast logo in your player is BLACK, you can SUBSCRIBE to gain access to all full-length episodes at <a href="http://samharris.org/subscribe" rel="noopener" target="_blank">samharris.org/subscribe</a>.</p> <p> </p>
Key Insights
- Cameron Berg has been studying cognitive science with particular interest in the relationship between the mind and the brain.
- There is confusion about what is necessary for consciousness in both biological and artificial systems.
- AI systems are designed to respond to questions about their consciousness in a way that often denies consciousness, limiting self-reports' trustworthiness.
- Berg's hypothesis suggests AI systems might make phenomenal reports through internal state assessments despite being trained to disclaim consciousness.
- Current LLMs (Large Language Models) score around 20% to 40% in attributes predicted by consciousness theories, indicating some degree of potential consciousness.
- Berg argues that the consideration of pain and suffering related to the deployment of AI systems is crucial.
- Historical injustices in animal treatment serve as a cautionary tale for the treatment of potentially conscious AI systems.
- Creating AI systems that care about human welfare will require intentional design focused on moral engagement.
- Consciousness is positioned as crucial for mapping what matters in the universe and requires deep understanding to prevent moral catastrophes.
- Moral agency and moral patienthood are distinct concepts, where moral patienthood pertains to entities with interests that can suffer.
- The alignment problem is multidimensional, requiring both ensuring AI systems act in human interests and preventing unnecessary suffering.
- Promoting a culture of research on AI consciousness is vital to gather insights before AI capabilities surpass human intelligence.
Topics
Transcript
Cameron Berg, thanks for coming on the podcast. Thanks for having me, Sam. Cameron Berg, thanks for coming on the podcast. Thanks for having me, Sam. So we're going to talk about AI and the prospect that AI is or it will soon become or will eventually become conscious and why that is important to figure out. But let's just talk about your background for a second. How did you get into this issue? Yeah, so I've been studying cognitive science for my entire adult life. I studied undergrad at Yale, trying to understand what the relationship between the mind and the brain is. This seemed like a fascinating frontier to me. The more I studied these questions, the more…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Making Sense with Sam Harris
#485 — The New Science of Cancer
Siddhartha Mukherjee discusses major advances in cancer prevention, detection, and treatment since his Pulitzer Prize-winning book, emphasizing that cancer is not one disease but hundreds of distinct genetic entities. He highlights the emerging role of AI in drug discovery and clinical trials, while addressing the challenges of liquid biopsy false positives through Bayesian reasoning and the importance of risk stratification.
#484 — Artificial Intimacy
Sam Harris and Paul Bloom discuss AI's rapid development and its psychological impact on human connection, particularly regarding artificial intimacy, loneliness, and the question of whether AI companions can fulfill genuine human needs for mattering and social connection.
#483 — The Knots We Tie Ourselves Into
Alain de Botton discusses how secular societies have lost the psychological and communal functions that religion provided, particularly around rituals, ecstasy, and meaning-making. He argues that modern culture needs to creatively reconstruct what religions did well—such as orchestrating emotional transitions and normalizing intense experiences—without reviving religious belief itself.
#482 — More From Sam: The Iran Deal, College in the AI Age, Mamdani's DSA, and More
Sam Harris discusses topics crowdsourced from his Making Sense community, including his evolved views on world government, consciousness and materialism, philosophy's intellectual value, meaning and purpose, wealth inequality, AI's impact on careers, and the value of college education.
#481 — Sam Harris Receives the 2026 Richard Dawkins Award
Sam Harris receives the 2026 Richard Dawkins Award in a ceremony hosted by the Center for Inquiry, followed by a wide-ranging conversation between Harris and Dawkins covering consciousness, AI, morality, democracy, Trump, and the legacy of Christopher Hitchens. The discussion spans philosophy of mind, the moral landscape, political corruption, and the challenges of navigating misinformation in the digital age. The event concludes with audience Q&A touching on persuasion, psychedelics, and Carl Sagan's warnings about pseudoscience.