ModalSearcher: Autonomous Cross-Modal Search Agent for Multimodal QA
ModalSearcher introduces autonomous cross-modal search, enabling agents to dynamically choose between reasoning, text search, image search, and reverse-image search. The authors propose a pipeline to build interleaved multimodal knowledge graphs and train an 8B agent with SFT and RL, achieving 16.2-point average accuracy gains over Qwen3-VL-8B on five benchmarks.
Why it matters: This paper presents a concrete method and benchmark for improving multimodal agents' ability to handle knowledge-intensive tasks, with measurable gains.