NewsResearch

AI designs viruses never seen in nature

The Rundown AI

Researchers used AI to design 16 novel viruses that infect only bacteria, successfully creating them in the lab to combat drug-resistant infections. While the work demonstrates beneficial applications, experts warn that the same AI tools could be repurposed to create dangerous pathogens, prompting calls for biosafety guardrails.

Summary

Stanford and Arc Institute researchers achieved a significant milestone by using AI language models (Evo 1 and Evo 2) to design 16 completely new viruses never found in nature. The models were trained on millions of existing genomes and tasked with creating variants of Phi X174, a bacteriophage that infects E. coli. Of 285 synthesized phages tested, 16 were viable, with some replicating faster than the original virus and several distinct enough to qualify as new species. The AI-designed viruses successfully eliminated E. coli strains that had developed resistance to the natural version, demonstrating practical therapeutic potential for treating antibiotic-resistant infections.

The research raises significant biosecurity concerns despite safety measures taken during development. The researchers deliberately avoided training the models on viruses that infect humans, animals, or plants to prevent generation of dangerous pathogens. However, the technology is fundamentally dual-use: the same AI capabilities that design beneficial bacterial viruses could theoretically be repurposed to create harmful pathogens if trained on different datasets. Evo 2 has been released as open source, and the field is advancing rapidly, creating pressure for the development of biosafety testing frameworks and regulatory guardrails.

Anthropically addressed related concerns by rewriting the safety classifier for their Fable 5 model, which handles biology-related queries. The original system was overly restrictive, blocking nearly all biology questions even from legitimate researchers. The updated classifier reduces false positives by approximately 85%, allowing the model to answer educational and healthcare questions while still restricting dual-use research involving virology, toxicology, and molecular design. This represents a deliberate balance between enabling beneficial access and preventing misuse, though the company acknowledges it may frustrate legitimate researchers seeking capabilities for important work.

About this episode

PLUS: Turn any idea into an AI-powered site with Lovable

Key Insights

  • Stanford researchers used AI language models trained on millions of genomes to generate 16 completely novel viruses that infect bacteria, with some showing superior replication rates compared to natural variants.
  • The researchers deliberately restricted their AI training data to exclude human, animal, and plant pathogens as a safety measure to prevent the system from generating dangerous viruses.
  • The same AI technology designed for beneficial phage therapy could be repurposed for creating harmful pathogens if trained on different data, demonstrating the fundamental dual-use nature of the capability.
  • Anthropic's rewrite of Fable 5's safety classifier reduced false-positive blocks on biology questions by approximately 85%, but the model still routes dual-use queries involving virology and molecular design to less capable alternatives.
  • The field is moving rapidly with open-source releases like Evo 2, creating mounting pressure for regulatory frameworks and testing protocols to ensure biosafety standards across AI biology applications.

Topics

AI-designed viruses and synthetic biologyBiosafety and dual-use research risksAntibiotic-resistant infection treatmentAI safety classifiers and content moderationOpen-source AI model governance

Transcript

Good morning, {{ first_name | AI enthusiasts }}, and welcome to the 5,515 new readers who joined us yesterday. Scientists just used AI to design viruses that don't exist in nature, then created them in the lab and watched them come to life and infect their targets. The viruses are harmless — they only attack bacteria, with the goal of fighting drug-resistant infections. The worry is what happens if the same tools get repurposed, the way we've seen in cybersecurity, to invent something dangerous. AI designs working viruses from scratch Rowan’s Corner: The best AI use cases aren’t coming from labs Turn any idea into an AI-powered site with Lovable Anthropic solves Fable 5’s biggest problem COMMUNITY AI WORKFLOW OF…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Rundown AI

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.