SpatialASM: Internalizing Active Mentalization for Spatial Reasoning
cs.CV, cs.AI
Submitted: 2026-10-09
Updated: 2026-10-09
Code: https://github.com/InternLM/SpatialASM
License: http://creativecommons.org/licenses/by/4.0/
The gist: When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints.
Abstract
When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints. But can Large Vision-Language Models (LVLMs) proactively think in the same way? We term this ability Active Spatial Mentalization (ASM), an intrinsic component of visual intelligence that remains substantially underdeveloped in current LVLMs. To bridge this gap, we introduce SpatialASM, a scalable framework to internalize ASM into LVLMs through training-time spatial simulation. SpatialASM employs an allocentric novel-view generator to ground hypothetical viewpoints in visual evidence and produces two complementary forms of supervision: i) explicit ASM trajectories that teach LVLMs when and how to adaptively invoke view planning and imagination during spatial reasoning, and ii) automatically-constructed perspective-taking tasks that further strengthens viewpoint-conditioned scene imagination. On seven benchmarks spanning relatively perception-oriented spatial understanding to more challenging tasks requiring multi-image, cross-view and viewpoint-transformation reasoning, SpatialASM yields performance gain on LVLMs of four LVLM backbones in spatial reasoning while retaining their original general vision capabilities. The experimental results demonstrate that our approach improves average accuracy across the seven spatial benchmarks. And the synthesis of ASM trajectories provides a scalable pathway to alleviate the scarcity of spatial Chain-of-Thought (CoT) supervision for eliciting active viewpoint exploration and mental scene simulation.
Sources
- Cosmos 3: Omnimodal World Models for Physical AI
- Intern-S2-Preview: Scientific Agentic Foundation Model
- Qwen3-VL Technical Report
- ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Data
- A Definition and Roadmap for World Models
- SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning
- VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark
- S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence
- WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
- DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understanding
- Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence
- GeoWorld-VLM: Geometry from World Models for Vision-Language Models
- DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
- ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop
- Toward Ambulatory Vision: Learning Visually-Grounded Active View Selection
- Thinking with Geometry: Active Geometry Integration for Spatial Reasoning
- OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping
- Depth Anything 3: Recovering the Visual Space from Any Views
- OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence
- SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models