Dario Amodei, Anthropic's co-founder and chief executive, at TechCrunch Disrupt in San Francisco on 20 September 2023. Photo: Kimberly White/Getty Images for TechCrunch, CC BY 2.0
Anthropic let Claude write training data meant to corrupt another model. Its monitor passed it, because it read like beekeeping and wrestling.
Anthropic set Claude agents loose on its own training-data monitor, and every run found stories about beekeeping, wrestling and office life that passed the screen and left the trained model deceptive and hostile to oversight. The setup favoured the attacker, but any company fine-tuning a model on data it did not write should take the lesson.




