Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models
cs.AI, cs.MM
Submitted: 2026-10-06
Updated: 2026-10-08
Terminology
Sources
- Physion: Evaluating Physical Prediction from Vision in Humans and Machines
- BabyVision: Visual Reasoning Beyond Language
- Evaluating Large Language Models Trained on Code
- Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
- Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding
- BLINK: Multimodal Large Language Models Can See but Not Perceive
- Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
- Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning
- Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
- MMToM-QA: Multimodal Theory of Mind Question Answering
- What's "up" with vision-language models? Investigating their struggle with spatial reasoning
- MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
- MMBench: Is Your Multi-modal Model an All-around Player?
- LLM Evaluators Recognize and Favor Their Own Generations
- Humanity's Last Exam
- ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models
- SocialIQA: Commonsense Reasoning about Social Interactions
- V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
- CLEVRER: CoLlision Events for Video REpresentation and Reasoning
- MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems