Live intelligence

Latest AI updates

3 updates
Research

Vision-as-a-Tool Framework Offloads Visual Reasoning in Agentic Coding

Researchers propose Vision-as-a-Tool, a paradigm that treats multimodal large language models as callable external utilities for visual reasoning. They implement the idea in VHarness, a framework built around five atomic actions for agentic coding workflows. Evaluations on Image-to-HTML, Image-to-SVG, and Image-to-3D tasks report improved visual fidelity and geometric accuracy for both text-only and multimodal coding agents.

Vision-as-a-ToolVHarnessMultimodal agents
Research Editor selected

VisSearch-Bench: New Benchmark Evaluates Long-Horizon Visual Search in Multimodal Agents

VisSearch-Bench introduces 204 human-written tasks across 7 domains to evaluate multimodal agents on visual context management during long-horizon search. It covers five task types requiring agents to combine visual details with external information. Benchmarking 16 models shows the best system solves only 26.47% of tasks, highlighting significant room for improvement.

Why it matters: Provides a concrete, recent benchmark with clear results that quantify current limitations in multimodal agent visual search, valuable for researchers and developers.

multimodal agentsvisual searchbenchmarking
Research Editor selected

RxnMiner: A Multimodal Agent for Structured Reaction Data Extraction from Chemistry Figures

RxnMiner is a multimodal agent that combines an expert-informed extraction procedure with a chemistry toolbox to recover structured reaction records from chemistry figures. It handles molecular recognition, shared-template evidence, substituent tables, product grids, and reconstruction of indirectly specified participants. The authors also introduce ChemRxn-Bench, containing 603 reaction figures and 8,547 manually annotated records. With Qwen3.8-Flash-Next as backbone, RxnMiner raises stereochemistry-aware reaction macro-F1 from 21.0% under direct prediction to 71.0%, versus 25.0% for the strongest existing extraction system, and produces 88,202 source-linked records from 10,107 figures without human intervention.

Why it matters: It presents a concrete multimodal extraction system and benchmark that could substantially reduce manual effort in building chemistry reaction datasets for AI models.

RxnMinerChemRxn-Benchchemical reaction extraction