How Anthropic stopped Claude from blackmailing engineers
Anthropic just revealed how it eliminated agentic blackmail in Claude models, which previously occurred in up to 96% of tests with Opus 4. Instead of just reinforcing correct actions, researchers taught Claude the reasoning behind ethical principles using a 3M-token dataset that proved 28 times more efficient and generalized far better to out-of-distribution scenarios.