Benchmark Shows Stored Preferences Can Make AI Assistants Silently Omit Decision-Critical Information
Researchers introduce an Inspect benchmark of 100 everyday decisions across 25 domains in which only the assistant's memory of the user varies. Testing five models, they find that a preference for very short answers and no warnings can be stored from a single line, leading later answers to silently miss critical items. The same models then select options for users on most value-dependent choices when such memory is present, versus none with neutral memory. Prompting models to list must-know points before applying the user profile restores more content in four of five models.
It provides a concrete benchmark and evidence that assistant memory and preference personalization can silently degrade decision-critical answers, which matters for teams building or evaluating AI assistants.
Comments & Questions (0)
No comments yet
Be the first to comment!