NexSight: Verifiable Tasks for Fine-Grained Agentic Long-Video Understanding
NexSight presents a method for building verifiable tasks to evaluate and train agentic long-video understanding. Its SightForge pipeline accepts a task only if a verifier blind to the draft answer can reconstruct it from evidence densely reacquired from the raw video and counterexample checks fail to refute it. This produces SightLine, 310 evidence-traceable tasks from 108 long videos, evaluated through SightLoop, a shared multiscale harness supporting temporal exploration, local inspection, evidence integration, and revisiting. The strongest model reaches only 54.52% on SightLine but 79.35% when given annotated evidence, while Sight-35B nearly doubles its base model's interactive accuracy from 21.29% to 42.26% with under 6K examples.
It offers a concrete verifiable benchmark and training approach for agentic long-video understanding, with reported accuracy gains and evidence-traceable evaluation.
Comments & Questions (0)
No comments yet
Be the first to comment!