Illusory Pattern Perception Drives Spurious Inference in Large Language Models
cs.AI
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: accepted by NeurIPS 2026
Code: https://github.com/NusIoraPrivacy/illusory
License: http://creativecommons.org/licenses/by/4.0/
The gist: Illusory pattern perception is a well-documented human cognitive tendency to infer meaningful relationships in data that is actually random.
Abstract
Illusory pattern perception is a well-documented human cognitive tendency to infer meaningful relationships in data that is actually random. Such a tendency, often described as "connecting the dots" where none exist, can result in systematic reasoning errors. This paper investigates whether Large Language Models (LLMs) exhibit such perceptual tendencies, which can lead to systematic errors in downstream applications. To our knowledge, this work presents the first systematic study of illusory pattern perception in LLMs, adapting classic psychological paradigms to three tasks with direct empirical comparison to human behaviors. We find that LLMs frequently exhibit stronger illusory pattern perception than humans. In particular, models tend to over-associate frequent positive attributes with majority groups or large organizations, and show increased tendencies to construct causal narratives from ambiguous events. To uncover the mechanism behind these behaviors, we develop a feature interpretability framework based on Sparse Autoencoders (SAEs) to analyze internal representations. Our results reveal that holistic frequency perception and analytic cognitive orientation are linked to the emergence of illusory perceptions. These findings highlight a previously underexplored cognitive-like illusion that may affect the reliability of LLM reasoning. Code available at https://github.com/NusIoraPrivacy/illusory.
Sources
- Revolutionizing Finance with LLMs: An Overview of Applications and Insights
- GPT-4o System Card
- GPT-4 Technical Report
- DeepSeek-V3 Technical Report
- Gemma 2: Improving Open Language Models at a Practical Size
- Qwen2.5 Technical Report
- Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders
- Machine Psychology
- Qwen3 Technical Report
- Gemma 3 Technical Report
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
- ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generation
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems