Human-Like Attention? A Psychophysical Comparison of Visual Search in Humans and MLLMs
cs.HC, cs.AI, cs.CV
Submitted: 2026-10-04
Updated: 2026-10-04
Journal ref: Computational Brain & Behavior (2026)
DOI: 10.1007/s42113-026-00333-4
License: http://creativecommons.org/licenses/by/4.0/
The gist: Visual search is a fundamental cognitive ability.
Abstract
Visual search is a fundamental cognitive ability. This study investigates whether Multimodal Large Language Models (MLLMs) exhibit human-like difficulty signatures in visual search tasks. We compared search performance of humans (n = 1,250) and MLLMs using identical 2D and 3D stimuli across different set sizes. Both groups showed efficient performance in feature searches, most clearly when the target had a unique color, but performance degradation in conjunction searches as set sizes increased. Additionally, we found strong correlations between human and MLLM error rates (ρ= 0.82), which suggests that MLLMs are sensitive to similar objective complexities, such as stimulus heterogeneity. However, differences were found as well: whereas humans invested extra search time to respond accurately on target-absent trials, MLLMs exhibited extreme present/absent response biases in complex searches. We conclude that MLLMs replicate high-level human performance signatures, yet their underlying computations differ significantly.
Sources
- I Spy With My Model's Eye: Visual Search as a Behavioural Test for MLLMs
- Attention Alignment Between Humans and Vision-Language Models
- Gemma 3 Technical Report
- Human Cognitive Benchmarks Reveal Foundational Visual Gaps in MLLMs
- Visual Structures Helps Visual Reasoning: Addressing the Binding Problem in VLMs
- Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting
- Do vision-language models search like humans? Reasoning tokens as a reaction-time analog in classic visual-search paradigms
- Exploring Perceptual Limitation of Multimodal Large Language Models
- From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures
Related papers
- Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Explanation User Interfaces: A Systematic Literature Review
- Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting