Anthropic’s Safety Superpower

The transcript begins by acknowledging cynics who view Anthropic's safety announcements as marketing scare-mongering. Anthropic first released 'Mythos Preview' as too dangerous to make public, then released 'Fable' two months later with safety guardrails. The author found Fable subjectively impressive — comparable in generational impact to GPT-4 and Grok 4 — and believes it stems from a new pre-training run.

Shortly after Fable's release, a jailbreak was discovered (apparently reported by Amazon, an Anthropic investor), prompting the U.S. government to issue an export control directive suspending all foreign national access to Fable 5 and Mythos 5. Anthropic contested the directive, arguing the jailbreak was narrow and non-universal, and that the vulnerabilities found were minor and discoverable by other public models. Senior Anthropic staff traveled to Washington to resolve what they called a misunderstanding, while the White House characterized it as leadership insouciance toward national security.

The author then explores the economic context: frontier AI labs like Anthropic and OpenAI have lost tens of billions building models that get distilled and commoditized by open-source competitors, primarily from China. The author argues that the only sustainable economic position is owning the user touchpoint — replacing software rather than being an input to it — putting frontier labs on a collision course with software companies. Satya Nadella's counter-vision, where companies build proprietary learning loops on top of interchangeable models, is presented as the opposing camp, though the author suggests the hollowing-out Nadella warns against may be inevitable.

On data, the author notes that heavily subsidized subscription plans (e.g., $200 plans estimated to provide $8,000–$14,000 in token value) serve a dual purpose: acquiring users and gathering real-world usage data for model improvement. Anthropic controversially changed its data retention policy with Fable, retaining all user data for 30 days even for enterprise clients who previously had zero-retention agreements — justified on safety grounds but with no structural safeguards against future training use.

The most controversial policy, however, was Anthropic's plan to silently degrade Fable's performance for requests related to frontier LLM development — without user notification. The author views this as Anthropic explicitly demonstrating both the capability and willingness to secretly alter model behavior to enforce its own policy preferences, validating supply-chain risk concerns. Anthropic walked this back (switching to a disclosed handoff to an older model instead), but the author sees the original policy as revealing: Anthropic believes only it should be developing frontier AI and, by extension, should have final say over AI globally.

The author concludes by examining Anthropic's 'safety story' as the unifying narrative that makes all these actions coherent internally. Unlike OpenAI, which suffered internal misalignment after ChatGPT turned it into an accidental consumer tech company, Anthropic has near-perfect alignment between its talent, mission, and business model. Every commercially beneficial policy decision — data retention, access restrictions, model degradation — can be framed as safety-motivated. The author respects this alignment as strategically effective (comparing it to Apple's user-centric framing of self-serving decisions) but fears it deeply, arguing that brilliant people convinced of their own benevolent necessity have a historically sordid track record — especially when building technology with the potential to rival nation-state-level power.