Live intelligence

Latest AI updates

1 updates
Research

MuSeToM benchmark tests LLM belief revision across six sensory cues

Researchers introduce MuSeToM, a human-validated text-based benchmark for evaluating epistemic belief revision in Theory of Mind reasoning. It contains 2,415 instances adapted from BigToM and OpenToM, with textual cues spanning six sensory categories. The benchmark tests whether models can decide when a protagonist should revise a belief and infer the updated belief state. Evaluations under direct and chain-of-thought prompting show models often detect possible belief change but struggle to identify the updated belief and over-update on salient but insufficient cues.

Theory of MindLarge Language ModelsBenchmarking