MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph
cs.CV, cs.CL
Submitted: 2026-10-09
Updated: 2026-10-09
Code: https://github.com/AAAndy-Zhu/MVGraph
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce MVGraph, a benchmark for evaluating large vision-language models (LVLMs) on multi-graph reasoning where the evidence required by a query is distributed across multiple interrelated
Terminology
Abstract
We introduce MVGraph, a benchmark for evaluating large vision-language models (LVLMs) on multi-graph reasoning where the evidence required by a query is distributed across multiple interrelated visual graph views. Although such evidence commonly resides in source-specific graphs, temporal snapshots, or local observations, existing graph reasoning benchmarks remain confined to a single self-contained structure, assessing only graph perception and reasoning while leaving the alignment and composition of evidence across views underexplored. MVGraph comprises 8k instances spanning 8 graph-theoretic tasks, abstracted from two multi-graph scenarios (partial and temporal graph views). Each problem is programmatically constructed and verified to be unsolvable from a single view. Beyond end-to-end evaluation, we decompose multi-graph reasoning into four complementary capabilities---Perception, Alignment, Composition, and Reasoning---and design 29 diagnostic tasks with 64k instances to probe each one, along with golden intermediate representations for evaluating the intermediate process. Across 15 LVLMs, we reveal the difficulty of multi-graph reasoning and identify cross-view edge alignment and relation-level composition as prominent bottlenecks through stage-oriented diagnostics. Meanwhile, temporal constraints and increasing view counts expose further capability boundaries. Code and data are available at https://github.com/AAAndy-Zhu/MVGraph.
Sources
- Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark
- GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
- Ovis2.5 Technical Report
- On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability
- MileBench: Benchmarking MLLMs in Long Context
- GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models
- Gemma 4 Technical Report
- Benchmarking Multimodal Mathematical Reasoning with Explicit Visual Dependency
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- GLM-5: from Vibe Coding to Agentic Engineering
- Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models