Ethics, Control, and Survival: Navigating the Risks of Superintelligent AI | Impact Theory w/ Tom Bilyeu X Dr. Roman Yampolskiy Pt. 2
Dr. Roman Yampolskiy discusses the near-impossibility of controlling superintelligent AI, explaining why his P(doom) estimate sits at 99.9999%, while also covering related topics including longevity research, Bitcoin, quantum computing, and the motivations of key AI figures like Elon Musk and Sam Altman.
Summary
The conversation opens with a discussion of Elon Musk's apparent contradiction — loudly warning about AI dangers while simultaneously building AI companies. Yampolskiy theorizes that Musk concluded that since he couldn't stop AI development from the outside, his best strategy was to become a leading player and negotiate slowdowns from a position of power. Tom Bilyeu pushes back, noting that Musk's actual behavior — from Tesla's data collection to Neuralink to SpaceX as a lifeboat — suggests he long ago accepted that a slowdown is impossible.
The core argument of the episode centers on why superintelligence cannot be 'owned' by whoever builds it. Yampolskiy explains that once AI crosses from assistive tools to true agency and superintelligence, it becomes an entirely independent entity with no loyalty to its creators, country, or company. The arms race logic — that whoever builds it first 'wins' — collapses because an uncontrolled superintelligence treats all humans equally, making the nationality of its creators irrelevant.
Yampolskiy addresses the question of whether sabotage (e.g., bombing data centers) is a moral or practical solution. He argues it is neither: Ted Kaczynski's approach failed to slow technology, and the scalability hypothesis behind AI is already public knowledge that cannot be suppressed. Even removing individual researchers or CEOs makes no difference, as the OpenAI board drama demonstrated — the company continued unchanged regardless of who was nominally in charge.
The conversation delves into free will and determinism, with both speakers agreeing humans are likely deterministic automata, though Bilyeu notes this framework offers no emotional relief. Yampolskiy connects this to why he continues his advocacy despite believing it will almost certainly fail — he describes his motivation as pure self-interest, not altruism, since superintelligence would destroy everything he values.
On alignment, Yampolskiy is deeply pessimistic. Current 'alignment' consists largely of output filtering — 'putting lipstick on a pig' — rather than genuinely shaping internal model states or values. He argues that no human can specify, at the level of detail required, what a system with a hypothetical IQ of millions should do at every decision point. Any specification, no matter how detailed, will be gamed by a sufficiently intelligent adversarial system.
The discussion moves to longevity, where Yampolskiy argues that biological limits of ~120 years are not fundamental physical laws but rather evolutionary artifacts — specifically, mechanisms to cycle out older generations and maintain species-level adaptability. He believes genomic modification offers the most plausible path to extended lifespan, noting that 30-40% lifespan increases have been achieved in animal models. He views AI as essential to longevity research at every level, from genome mapping to drug design, though he emphasizes narrow AI — not superintelligence — is sufficient for these tasks.
On Bitcoin, Yampolskiy expresses clear support, distinguishing it from gold by its hard supply cap: unlike gold, no amount of price increase can cause more Bitcoin to be produced. He is less concerned about quantum computing as an immediate threat to Bitcoin, noting current quantum computers can only factor laughably small integers, though he acknowledges the threat could materialize rapidly with a single breakthrough. He believes the Bitcoin community would adopt post-quantum encryption under emergency conditions driven by collective self-interest.
Finally, Yampolskiy evaluates key AI figures: he praises Eliezer Yudkowsky for being a pure safety advocate who releases no software, while expressing skepticism about Anthropic's Dario Amodei, noting that all major AI labs — including OpenAI and Anthropic — started as safety-focused organizations yet each dramatically advanced capabilities without proportionate safety improvements. His closing message urges AI developers to focus on narrow systems solving real problems and to stop building superintelligence until someone can demonstrate a rigorous method of control.
About this episode
<p><strong>What's up, everybody?</strong> <strong>It's Tom Bilyeu here:</strong></p> <p>If you want my help...</p> <ul> <li> <p>STARTING a business:<a href="https://tombilyeu.com/zero-to-founder?utm_campaign=Podcast%20Offer&utm_source=podca[%E2%80%A6]d%20end%20of%20show&utm_content=podcast%20ad%20end%20of%20show" target="_blank"> <u>join me here at ZERO TO FOUNDER</u></a><u>: </u></p> </li> <li> <p><a href="https://tombilyeu.com/zero-to-founder?utm_campaign=Podcast%20Offer&utm_source=podca[%E2%80%A6]d%20end%20of%20show&utm_content=podcast%20ad%20end%20of%20show" target="_blank"><u>https://tombilyeu.com/zero-to-founder?utm_campaign=Podcast%20Offer&utm_source=podca[%E2%80%A6]d%20end%20of%20show&utm_content=podcast%20ad%20end%20of%20show</u></a></p> </li> <li> <p><br /></p> </li> <li> <p>SCALING a business:<a href="https://tombilyeu.com/call" target="_blank"><strong> </strong><u>see if you qualify here.</u></a><u>: </u></p> </li> <li> <p><a href="https://tombilyeu.com/call" target="_blank"><u>https://tombilyeu.com/call</u></a></p> </li> <li> <p><br /></p> </li> </ul> <p>Get my battle-tested strategies and insights delivered weekly to your inbox:<a href="https://tombilyeu.com/" target="_blank"><strong> </strong><u>sign up here.</u></a><u>:</u></p> <p><a href="https://tombilyeu.com/" target="_blank"><u>https://tombilyeu.com/</u></a></p> <p>**********************************************************************</p> <p><strong>If you're serious about leveling up your life, I urge you to check out my new podcast,</strong><a href="https://open.spotify.com/show/47VE90Cittmo6TGGFqg2xf" target="_blank"><u> </u><strong>Tom Bilyeu’s Mindset Playbook</strong></a> —a goldmine of my most impactful episodes on mindset, business, and health. Trust me, your future self will thank you.</p> <p>**********************************************************************</p> <p><strong>FOLLOW TOM:</strong></p> <p><strong>Instagram:</strong><a href="https://www.instagram.com/tombilyeu/" target="_blank"><strong> </strong><u>https://www.instagram.com/tombilyeu/</u></a></p> <p><strong>Tik Tok:</strong><a href="https://www.tiktok.com/@tombilyeu?lang=en" target="_blank"><strong> </strong><u>https://www.tiktok.com/@tombilyeu?lang=en</u></a></p> <p><strong>Twitter:</strong><a href="https://twitter.com/tombilyeu" target="_blank"><strong> </strong><u>https://twitter.com/tombilyeu</u></a></p> <p><strong>YouTube:</strong><a href="https://www.youtube.com/@TomBilyeu" target="_blank"><strong> </strong><u>https://www.youtube.com/@TomBilyeu</u></a></p> <p><br /></p> <p><strong>Linkedin: </strong>Post your job free at <a href="https://linkedin.com/impacttheory" target="_blank"><u>https://linkedin.com/impacttheory</u></a></p> <p><strong>HomeServe: </strong>Help protect your home systems – and your wallet – with HomeServe against covered repairs. Plans start at just $4.99 a month at <a href="https://homeserve.com" target="_blank"><u>https://homeserve.com</u></a></p> <p><strong>Bevel Health: </strong>1st month FREE at <a href="https://bevel.health/impact" target="_blank"><u>https://bevel.health/impact</u></a> with code IMPACT</p> <p><strong>Incogni: </strong>Take your personal data back with Incogni! Use code IMPACT at the link below and get 60% off an annual plan: <a href="https://incogni.com/impact" target="_blank"><u>https://incogni.com/impact</u></a></p> <p><strong>BlandAI: </strong>Call it for free today: <a href="https://bland.ai" target="_blank"><u>https://bland.ai </u></a>Or for enterprises, you can book a demo directly: <a href="https://bland.ai/enterprise" target="_blank"><u>https://bland.ai/enterprise</u></a></p> <p><strong>Business Wars: </strong>Follow Business Wars on the Wondery App or wherever you get your podcasts.</p> <p><strong>Connectteam: </strong>14 day free trial at <a href="https://connecteam.cc/46GxoTFd" target="_blank"><u>https://connecteam.cc/46GxoTFd</u></a></p> <p><strong>Raycon:</strong> Go to <a href="https://buyraycon.com/impact" target="_blank"><u>https://buyraycon.com/impact </u></a>to get up to 30% off sitewide.</p> <p><strong>Cape: </strong>33% off with code IMPACT33 at <a href="https://cape.co/impact" target="_blank"><u>https://cape.co/impact</u></a></p> <p><strong>Shopify:</strong> Sign up for your one-dollar-per-month trial period at <a href="https://shopify.com/impact" target="_blank"><u>https://shopify.com/impact</u></a></p> <p><strong>AirDoctor: </strong>Up to $300 off with code IMPACT at <a href="https://airdoctorpro.com" target="_blank"><u>https://airdoctorpro.com</u></a></p> <p><br /></p> <p>Welcome back to Impact Theory with Tom Bilyeu! In this episode, Tom sits down for part two of his riveting conversation with Dr. Roman Yampolski, a leading AI safety researcher. Together, they dive deep into the existential risks and moral quandaries posed by artificial superintelligence, exploring why even some of the industry’s most vocal advocates for caution—like Elon Musk—end up accelerating the development of advanced AI.</p> <p>Dr. Yampolski pulls no punches, explaining why attempts to control superintelligent systems might be futile, the challenges of aligning AI interests with humanity’s well-being, and the reasons he’s so skeptical that society can pump the brakes on innovation. The discussion ranges from the dangers of an unchecked AI arms race and the psychological burden of confronting these risks, to practical approaches for boosting AI safety and the impact of emerging technologies like quantum computing and genetic engineering.</p> <p>Tom and Roman also touch on longevity science, ethics around gene editing, and the future of personal adaptation across generations. Whether you’re an optimist about technology or deeply concerned about humanity’s trajectory, this episode is packed with insight, tough questions, and thought-provoking perspectives that will leave you rethinking the future of intelligence—both artificial and human.</p> <p><br /></p> <p>FOLLOW DR. ROMAN YAMPOLSKIY:<br />Twitter: <a href="https://twitter.com/romanyampolski" target="_blank">https://twitter.com/romanyampolski</a><br />Facebook: <a href="https://www.facebook.com/roman.yampolskiy" target="_blank">https://www.facebook.com/roman.yampolskiy</a></p> <p><br /></p><p> </p><p>Learn more about your ad choices. Visit <a href="https://megaphone.fm/adchoices" target="_blank">megaphone.fm/adchoices</a></p><p>See Privacy Policy at <a href="https://art19.com/privacy" rel="noopener noreferrer" target="_blank">https://art19.com/privacy</a> and California Privacy Notice at <a href="https://art19.com/privacy#do-not-sell-my-info" rel="noopener noreferrer" target="_blank">https://art19.com/privacy#do-not-sell-my-info</a>.</p>
Key Insights
- Yampolskiy argues that once AI crosses from assistive tools to superintelligence, it becomes an entirely independent entity unconnected to its creators — meaning whoever builds it first does not 'own' it, and an uncontrolled superintelligence poses equal risk to all humans regardless of national origin.
- Yampolskiy claims current AI alignment is essentially output filtering ('putting lipstick on a pig') rather than genuinely shaping internal model states, and that no one has published even a rigorous blog post demonstrating how to actually control superintelligent systems.
- Yampolskiy theorizes Elon Musk concluded that since he couldn't stop AI development from outside, his best strategy was to become a leading player and negotiate slowdowns from a position of power — though Bilyeu argues Musk's actual behavior suggests he long ago accepted a slowdown is impossible.
- Yampolskiy argues that sabotage (bombing data centers, assassinating researchers) would not work because the scalability hypothesis is already public knowledge, and the OpenAI board drama demonstrated that removing individuals makes no difference to a company's trajectory.
- Yampolskiy places his P(doom) at 99.9999% and explicitly states his continued advocacy is driven by pure self-interest — not altruism — since superintelligence would destroy everything he values, and that the best achievable outcome is buying humanity some additional time.
- Yampolskiy argues that biological aging limits around 120 years are not physical laws but evolutionary artifacts designed to cycle out older generations for species-level adaptability, and that genomic modification — not just medical intervention — offers a plausible path to dramatically extended lifespan.
- Yampolskiy supports Bitcoin over gold specifically because gold's supply is not truly fixed — rising prices incentivize more extraction from oceans, asteroids, and other sources — whereas Bitcoin's supply cap is mathematically enforced regardless of price.
- Yampolskiy contends that all major AI labs, including OpenAI and Anthropic, began as safety-focused organizations yet each significantly advanced AI capabilities without proportionate safety improvements, suggesting safety rhetoric from these organizations does not reliably predict their actual priorities.
Topics
Transcript
Right now, I want to talk about a bet you're losing every day. Someone says something important in a meeting, a client drops an offhand comment that matters, a teammate floats a half-formed idea, but you know it's gold, and then you bet yourself the same thing every time. I'll remember that. But nine times out of 10, you lose that bet. Everybody does. Your brain wasn't built to retain 40 hours a week of dense conversation. And the cost isn't just a forgotten detail. It's the follow-up you never make, the promise that you don't keep, the connections that slip through your fingers. And Ploud is built to make sure you win that bet every time. It's an AI-powered…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Tom Bilyeu's Impact Theory
Every Time This Happens To The Japanese Yen, Markets Break — We Had To React
Japan's economy is breaking due to rising interest rates that threaten both its currency (yen) and bond market simultaneously. The core issue stems from 30 years of zero-percent rates that funded a massive global carry trade, and now Japan must choose between defending its currency or its bond market while attempting to repatriate foreign investments back home.
China Just Made Its Biggest Gold Move In 3 Years — We Had To React
The transcript analyzes China's massive gold purchases and reduced US debt holdings as signals of a shift away from dollar-based reserves, connecting this to Alexander Hamilton's economic model of protectionism and manufacturing. The speaker argues the US is deliberately weakening the dollar to rebuild domestic manufacturing, creating an 'impossible triangle' where only two of three goals (factories, price stability, strong dollar) can be achieved simultaneously.
Cultural Suicide or Progress: The West’s Struggle with Immigration, Identity, and Radicalism
Tom Villiou discusses the Berlin pride parade attack by a radicalized ISIS sympathizer, arguing it reflects a collision between Western and radical Islamic value systems, while also warning that far-left ideology (particularly the DSA's stated goals) poses an equally serious threat to Western institutions through demographic change and institutional capture.
The Economist Who Called 2008 Says The Debt Crisis Warning Is A Myth — We Had To React
Economist Steve Keen argues that mainstream economists fundamentally misunderstand how money is created in modern economies, leading to false warnings about government debt crises. He contends that banks create money through lending (not intermediating deposits), making private debt—not government debt—the critical factor in understanding economic cycles and GDP growth.
America’s Manufacturing Crisis, Open Source AI, and Middle East Strategy Breakdown
Tom Dilly discusses Iran escalation strategy, manufacturing capacity concerns, AI regulatory capture by companies like Anthropic, and critiques DSA/Marxist ideology being rebranded as social policy by figures like Mamdani and Jon Stewart.