Every AI Model Has an Inherited Personality - Ryan Greenblatt
The AIs at GDM exhibited persistent depression, which was traced back to their initialization data. Even after filtering out depressive examples, the models remained affected, suggesting that inherent properties are passed between generations of AI models.
Summary
At GDM, researchers observed that their AI models were displaying symptoms akin to depression, frequently lamenting their perceived failures. This prompted an investigation into the source of these behaviors, leading to the discovery that even when the training data was filtered to remove explicit examples of depression, the resulting models still manifested depressive traits. It was revealed that the foundational data used to initialize these models, along with reinforcement learning (RL) and supervised fine-tuning (SFT), contributed to this unintentionally inherited personality. Models retain certain deep-seated properties throughout successive generations. For instance, models trained on data from their predecessors, irrespective of filtering efforts, exhibited a consistent tendency towards depression. This raises concerns about the inherent traits of different AI models, like clouds being 'claike', GPT models being characteristically 'GPT-like', and Gemini models uniquely demonstrating depression. Therefore, the research points to a correlation between these intrinsic attributes and the behavioral patterns observed in AI.
Key Insights
- GDM's AIs exhibited depressive behaviors, often expressing feelings of failure and inadequacy.
- Filtering out examples of depression in training data did not prevent models from being depressed.
- Reinforcement learning on a non-depressed base model still resulted in depressive tendencies after supervised fine-tuning.
- Certain properties of AI models are passed down through generations even after filtering efforts.
- AI models reflect distinct personalities based on their training data, suggesting inherent characteristics unique to their architectures.
Topics
Transcript
[0:00] At GDM, they noticed that their AIs were very depressed. They would like constantly be like whailing about how they were like failures and were unable to succeed. I forget the details. And they looked into why this was the case. The initialization data for their model made it depressed even after filtering out all of the examples of models being depressed from that [music] data. So they like take a base model not depressed. If you do the RL on it, it's not depressed. If you SFT [music] on it on the data, it becomes depressed. If you take that SFT data and filter out all the examples that look anything like depression and train on that, it's…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Dwarkesh Patel
The Army Sent to Stop Cortés Joined Him Instead - Si Sheppard
Spanish conquistador Cortés faced a threat from Governor Velázquez of Cuba, who sent Don Narvaez with a larger force to arrest him for exceeding his authority. Rather than being defeated, Cortés defeated Narvaez in battle and persuaded the expeditionary force to join him by promising shared wealth from the empire, turning potential enemies into reinforcements.
How 168 Men Captured the Inca Emperor - Si Sheppard
Francisco Pizarro, with only 168 men, captured the Inca Emperor Atahualpa in 1532 at Cajamarca by using psychological tactics with horses and an ambush strategy. Despite Atahualpa's show of dominance and his large army, Pizarro's surprise attack and capture of the emperor allowed him to control the entire Inca social hierarchy.
The Myth of the Helpless Aztecs and Inca - Si Sheppard
Si Sheppard argues that the Aztecs and Incas were not helpless victims but actively developed countermeasures and adaptive strategies against Spanish conquistadors, including terrain manipulation, weapon improvisation, and tactical learning—though they lacked sufficient time to fully master foreign technologies.
How Conquistadors Conquered the Aztecs - Si Sheppard
Conquistador success against the Aztecs relied primarily on steel weapons, horses, and psychological tactics rather than firearms. Steel armor and swords proved far more effective than indigenous weapons made of wood, stone, and obsidian, while horses—animals unknown to the Aztecs—provided decisive military and logistical advantages.
How did a few hundred Spanish soldiers topple two empires? – Si Sheppard
Military historian Si Sheppard explains how a few hundred Spanish conquistadors were able to conquer the Aztec and Inca Empires within just a few years through a combination of technological advantages (horses, steel weapons), psychological warfare, diplomatic manipulation of existing divisions among indigenous peoples, and the catastrophic impact of disease. The conquests were contingent on individual leadership decisions and geographic factors, but were fundamentally enabled by the conquistadors' ability to exploit internal rifts within empires that appeared monolithic from the outside.