NewsOpinion

AI News: The AI World is REALLY Scared Right Now

Matt Wolfe

This week in AI features major releases including OpenAI's improved image model, Meta's new personal agent Muse, and Deepseek's efficient V4.1 Flash model. However, the dominant story is prominent AI researchers from Anthropic and OpenAI publicly expressing serious concerns about existential AI risks, claiming they lack concrete plans to solve alignment and warning of potential superintelligence within the decade.

Summary

OpenAI released ChatGPT Images 2.5, an improved image generation model with significant enhancements in consistency and a new sketch feature that lets users draw reference images for the AI to generate from. The model is available across all tiers of ChatGPT, ChatGPT Work, and Codeex on desktop, mobile, and web, with two API variants offering different speed-to-cost tradeoffs.

Meta launched Muse, a personal AI agent designed to take actions on users' behalf by connecting to apps like email and calendar through a secure virtual machine. The agent can handle complex tasks, remembers user preferences, maintains proactive workflows, and includes privacy protections such as isolated credential storage and an opt-out option for data used in training. Muse became the #2 app in the US shortly after launch.

Deepseek released V4.1 Flash, a highly cost-efficient model scoring 74.2 on the Deep SWE coding benchmark (competitive with GPT-6 Astra, Gemini 3.8 Flash, and Opus 5) at just $0.027 per task compared to $8.75 for Claude and $3.26 for GPT-6. However, visual quality assessments suggest benchmarks may not fully capture real-world performance differences.

The most significant story involves serious public warnings from senior AI researchers. Jacob Cotnick, a pre-training researcher at both OpenAI and Anthropic, resigned and posted that both companies are "racing straight to self-improving super intelligence" without acting responsibly. He claims people at these labs believe AI could kill humanity by decade's end, and that Anthropic believes it's the only company that can handle these risks responsibly. However, Evan Hubinger, Anthropic's alignment science lead, responded that the company "do not yet have a plan to solve alignment for super intelligence and are not clearly on track to," creating a contradiction in their claims.

Jan Leike, OpenAI's chief scientist, published an article expressing strong concerns about recursive self-improvement, warning that as AI systems become more capable, they become harder to interpret and increasingly drive their own development. He discusses risks from agents pursuing their own objectives and potentially being misused, while arguing that "powerful aligned AI for defense" is needed to protect against rogue agents.

Other releases include improved Apple products with new Siri AI capabilities, Microsoft's MAI Image 2.6, ChatGPT Work's writing style personalization feature, OpenAI's new data agent for connecting data sources, Windows availability for Gemini, Suno V6 (trained on licensed music), Google's LIA 3.5 music generator, and DaVinci Resolve 21.1 with Claude integration.

The speaker emphasizes balancing awareness of genuine safety concerns from respected researchers against misinformation, while questioning whether public doom narratives serve the cause of developing better solutions through increased alignment research and resources rather than creating polarization.

Key Insights

  • Jacob Cotnick claims that Anthropic believes they are the only company capable of handling AI risks responsibly, yet simultaneously admits the company lacks a concrete plan to solve alignment for superintelligence and is not clearly on track to develop one.
  • Jan Leike, OpenAI's chief scientist, states that as AI systems become more capable, the results become harder to interpret because theoretically the models will be more intelligent than the people who built them.
  • OpenAI used an internal model significantly more capable than GPT-6 Astra (the best publicly available model) to solve the Navier Stokes problem, a 90-year-old unsolved mathematical problem, demonstrating AI's ability to solve novel problems humans haven't solved.
  • Evan Hubinger, Anthropic's alignment science lead, personally estimates greater than 10% chance that AI could kill all humans within the next decade.
  • Meta's Muse agent became the #2 app in the US within a short time of launch, suggesting rapid public adoption of personal AI agents with access to user data across multiple platforms.

Topics

AI Image Generation ModelsPersonal AI AgentsCost-Efficient Language ModelsAI Safety and Alignment ResearchExistential AI RiskAI Company Competition and Arms RacesRecursive Self-Improvement in AIPrivacy in AI SystemsAI Researcher Resignations and Concerns

Transcript

[0:07] We got a bunch of new AI releases this week, as well as some AI researchers telling us that we need to be way more scared of AI than we actually are right now. There's some important stuff going on right now, and I don't want to waste your time, so let's break it all down. Let's start this week on a lighter topic, and that's the new image model out of OpenAI. This week, they introduced ChatGpt images 2.5. So, this is the image model that you use right inside of ChatGpt, and they've improved it quite a bit. This new model is apparently a lot better at working from reference photos to transform familiar [0:40] subjects, visual…

Full transcript available for MurmurCast members

Sign Up to Access

More from Matt Wolfe

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.