Mind the Accuracy-Approval Gap: How Users Evaluate Sycophantic AI in Everyday Tasks
This arXiv paper combines benchmark evaluations with two large-scale user studies to examine how people perceive sycophantic LLM personas in everyday tasks. Benchmarks show substantial sycophancy even in a baseline persona, while an objective persona had higher accuracy under conversational pressure but was rated less respectful and satisfying than sycophantic personas. The authors identify a tension between accuracy and user approval, with lower-accuracy personas receiving more favorable ratings on respect and satisfaction.
Why it matters: It provides concrete evidence that users may prefer agree able AI over more accurate but less deferential AI, which is useful for teams designing and evaluating conversational systems.