Evaluating Video LLMs' Understanding of Corner Cases in Autonomous Driving
Researchers introduce DashBench, a benchmark for evaluating Video Large Language Models on rare and safety-critical driving scenarios. It tests 25 Video LLMs on 1,709 curated driving videos covering collision-related and rare non-collision corner cases through open-ended question answering. The evaluation finds that all tested models perform substantially below the threshold required for safety-critical driving applications, often missing or misjudging dangerous events and hallucinating agents or actions. The work aims to support progress toward safer and more explainable autonomous driving systems.
Why it matters: It provides a concrete benchmark and evidence that current Video LLMs remain unreliable for safety-critical autonomous driving corner cases.