MentalGrid Benchmark and SpatialWalker Model Target Dynamic Spatial Simulation in MLLMs
Researchers introduce MentalGrid, a benchmark for testing whether multimodal large language models can simulate evolving spatial states without intermediate visual feedback. The evaluation finds existing models struggle, with simple scenarios limited by perception and complex ones by multi-step reasoning. The authors propose a three-stage curriculum learning framework using 16k specialized samples, producing SpatialWalker, which improves 33.8% on average over its base model and outperforms Gemini-3-Flash on spatial simulation. SpatialWalker also shows a 4.9% average gain on out-of-domain benchmarks.
It provides a concrete new benchmark and training approach for a known weakness in multimodal models, with measured results useful to AI researchers.
Comments & Questions (0)
No comments yet
Be the first to comment!