Anthropic confronts the RSI clock
This edition of The Rundown AI newsletter covers Anthropic's report on recursive self-improvement (RSI), noting that Claude already authors over 80% of Anthropic's merged code and is accelerating AI development faster than expected. It also covers OpenAI's new 'dreaming' memory system for ChatGPT, a coalition of AI CEOs urging Congress to regulate synthetic DNA to prevent bioweapon risks, and several other AI industry developments.
Summary
The newsletter's lead story covers Anthropic's newly published report titled 'When AI builds itself,' which examines recursive self-improvement (RSI) in AI systems. Anthropic disclosed that Claude now authors more than 80% of the company's merged code as of May 2026, and that engineers are pushing 8x as much code per day in Q2 2026 compared to 2024. Co-author Jack Clark described a trajectory where each new version of Claude could theoretically be built by the previous version without human involvement. Anthropic clarified that full RSI is not yet here or inevitable, but acknowledged the pace is faster than anticipated. The company also stated it would consider slowing or pausing frontier AI development if peer labs agreed to do the same, with policy discussions planned for coming months. OpenAI echoed similar RSI concerns in its own 'Democratic Governance of Frontier AI' blueprint.
The newsletter also covers OpenAI's major memory update for ChatGPT, dubbed 'dreaming.' This system runs in the background to build a continuously updated, category-sorted profile of each user based on past conversations. The update significantly improved ChatGPT's factual recall from 41.5% to 82.8% and preference-following from 31.4% to 71.3% in internal evaluations. The feature is rolling out initially to Plus and Pro users in the U.S.
On the AI safety front, CEOs from OpenAI, Anthropic, Google DeepMind, and Microsoft — including Sam Altman, Dario Amodei, Mustafa Suleyman, and Demis Hassabis — signed an open letter to Congress warning that AI systems now outperform PhD-level virologists in technical knowledge, enabling bad actors to potentially design bioweapons. They urged Congress to mandate that synthetic DNA and RNA sellers screen orders, verify buyers, and log sales.
Additional highlights include: Nvidia releasing the open 550B Nemotron 3 Ultra reasoning model; Canadian PM Mark Carney unveiling a five-year AI national strategy targeting $200B in growth; the U.S. and Japan announcing a $1B AI research partnership; CloudFlare co-founder Matthew Prince revealing that bot traffic now surpasses human traffic on the internet; and a reader workflow featuring AI-assisted parenting tips for managing toddlers.
Key Insights
- Anthropic's internal data shows Claude authored over 80% of the company's merged code as of May 2026, with engineers shipping 8x more code per day in Q2 2026 than in 2024, suggesting RSI dynamics are already influencing real development pipelines.
- Anthropic stated it would slow or pause frontier AI development if peer labs agreed to do the same, representing a notable shift toward conditional, coordinated restraint from a leading frontier lab.
- OpenAI's 'dreaming' memory system nearly doubled ChatGPT's factual recall (41.5% to 82.8%) and more than doubled preference-following (31.4% to 71.3%), suggesting background profiling significantly outperforms the previous fact-list approach.
- A coalition of top AI CEOs warned Congress that 'knowledge barriers which have historically prevented bad actors from obtaining biological weapons will meaningfully erode,' framing AI-enabled bioweapon design as an imminent regulatory gap rather than a distant risk.
- CloudFlare co-founder Matthew Prince revealed that bot traffic on the internet has already surpassed human traffic, a milestone he expected to arrive a full year later than it actually did, indicating AI-driven automation is outpacing even expert forecasts.
Topics
Full transcript available for MurmurCast members
Sign Up to Access