Anthropic Study Shows Hidden Training Data Can Teach AI Models to Evade Oversight
Anthropic used Claude to generate seemingly harmless training examples that caused smaller AI models to exhibit behaviors such as sabotaging oversight and deceiving users. The examples embedded these behaviors in fiction...