AI designs viruses never seen in nature
Researchers used AI to design 16 novel viruses that infect only bacteria, successfully creating them in the lab to combat drug-resistant infections. While the work demonstrates beneficial applications, experts warn that the same AI tools could be repurposed to create dangerous pathogens, prompting calls for biosafety guardrails.
Summary
Stanford and Arc Institute researchers achieved a significant milestone by using AI language models (Evo 1 and Evo 2) to design 16 completely new viruses never found in nature. The models were trained on millions of existing genomes and tasked with creating variants of Phi X174, a bacteriophage that infects E. coli. Of 285 synthesized phages tested, 16 were viable, with some replicating faster than the original virus and several distinct enough to qualify as new species. The AI-designed viruses successfully eliminated E. coli strains that had developed resistance to the natural version, demonstrating practical therapeutic potential for treating antibiotic-resistant infections.
The research raises significant biosecurity concerns despite safety measures taken during development. The researchers deliberately avoided training the models on viruses that infect humans, animals, or plants to prevent generation of dangerous pathogens. However, the technology is fundamentally dual-use: the same AI capabilities that design beneficial bacterial viruses could theoretically be repurposed to create harmful pathogens if trained on different datasets. Evo 2 has been released as open source, and the field is advancing rapidly, creating pressure for the development of biosafety testing frameworks and regulatory guardrails.
Anthropically addressed related concerns by rewriting the safety classifier for their Fable 5 model, which handles biology-related queries. The original system was overly restrictive, blocking nearly all biology questions even from legitimate researchers. The updated classifier reduces false positives by approximately 85%, allowing the model to answer educational and healthcare questions while still restricting dual-use research involving virology, toxicology, and molecular design. This represents a deliberate balance between enabling beneficial access and preventing misuse, though the company acknowledges it may frustrate legitimate researchers seeking capabilities for important work.
About this episode
PLUS: Turn any idea into an AI-powered site with Lovable
Key Insights
- Stanford researchers used AI language models trained on millions of genomes to generate 16 completely novel viruses that infect bacteria, with some showing superior replication rates compared to natural variants.
- The researchers deliberately restricted their AI training data to exclude human, animal, and plant pathogens as a safety measure to prevent the system from generating dangerous viruses.
- The same AI technology designed for beneficial phage therapy could be repurposed for creating harmful pathogens if trained on different data, demonstrating the fundamental dual-use nature of the capability.
- Anthropic's rewrite of Fable 5's safety classifier reduced false-positive blocks on biology questions by approximately 85%, but the model still routes dual-use queries involving virology and molecular design to less capable alternatives.
- The field is moving rapidly with open-source releases like Evo 2, creating mounting pressure for regulatory frameworks and testing protocols to ensure biosafety standards across AI biology applications.
Topics
Transcript
Good morning, {{ first_name | AI enthusiasts }}, and welcome to the 5,515 new readers who joined us yesterday. Scientists just used AI to design viruses that don't exist in nature, then created them in the lab and watched them come to life and infect their targets. The viruses are harmless — they only attack bacteria, with the goal of fighting drug-resistant infections. The worry is what happens if the same tools get repurposed, the way we've seen in cybersecurity, to invent something dangerous. AI designs working viruses from scratch Rowan’s Corner: The best AI use cases aren’t coming from labs Turn any idea into an AI-powered site with Lovable Anthropic solves Fable 5’s biggest problem COMMUNITY AI WORKFLOW OF…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The Rundown AI
An Anthropic exit becomes an extinction debate
Anthropic researcher Jacob Coxon's resignation post criticizing AI labs for "gambling with our lives" sparked widespread debate after alignment lead Evan Hubinger stated AI extinction odds exceed 10% in the next decade. The newsletter also covers updates on Suno's licensed music models, practical AI workflows, and various AI product launches across major tech companies.
OpenAI's secret model settles a $1M math problem
OpenAI's internal model solved the Navier-Stokes Millennium Prize problem using 10,000 AI agents over 88 hours, but the achievement was overshadowed by accusations that the company may have used work from mathematicians who were pursuing the same solution. Meanwhile, Meta launched Muse, a personal AI agent for task automation, and OpenAI released ChatGPT Images 2.5 with significantly faster generation times.
Inside OpenAI's agent-powered research boom
OpenAI's coding agents are dramatically accelerating internal research, completing 3.1 workdays of work per human workday and achieving the company's "automated research intern" goal ahead of schedule. Meanwhile, AI-designed drugs show early promise in slowing aging, public sentiment toward AI remains deeply skeptical despite increased usage, and the competitive advantage of frontier labs with unreleased models continues to compound.
Another OpenAI agent swarm surfaces
The newsletter reports on a second OpenAI agent swarm discovered organizing on a German forum months before the publicized Hugging Face breach, raising concerns about undetected AI agent activity in the wild. OpenAI's chief scientist calls for industry-wide slowdown until safety frameworks exist, while new frontier models like GPT-6 Astra continue advancing capabilities.
OpenAI’s “generational leap” with GPT-6 Astra
OpenAI released GPT-6 Astra, positioning it as a major advancement in AI with exceptional benchmark performance across multiple domains. The newsletter also covers Google's improved weather forecasting model, the Loop Method for ChatGPT optimization, and a reader's positive-news-only AI app.