Research
HumanSightBench: A Benchmark for Human Visual Perception in MLLMs
HumanSightBench is a new benchmark of 2,876 short-answer visual questions spanning 7 top-level perceptual categories and 21 subcategories. Items pass five inclusion gates—question clarity, answer uniqueness, visual grounding, human solvability, and text-only shortcut filtering—to reduce ambiguity and external-knowledge confounds. Across eight evaluated MLLMs, the best pass@3 score was 65.6%, and no model exceeded 27.5% on Counting. The results expose perception gaps that overall benchmark scores can obscure.
HumanSightBenchmultimodal large language modelsvisual perception