When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning
cs.AI, cs.CL
Submitted: 2025-05-21
Updated: 2026-09-02
Comments: Accepted in the Findings of EMNLP 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large reasoning models (LRMs) have achieved remarkable success on complex tasks, yet their tendency to "overthink" leads to inefficiencies.
Terminology
Abstract
Large reasoning models (LRMs) have achieved remarkable success on complex tasks, yet their tendency to "overthink" leads to inefficiencies. Although "save-thinking" prompts are intended to mitigate this issue, we find that LRMs still frequently enter the "Still-thinking" mode instead of the expected "No-thinking" mode, especially on difficult queries. To analyze this behavioral divergence, we examine LRMs from three perspectives: confidence at the thinking-termination boundary, divergence in internal attention distributions, and attention allocation across prompt segments. We find that high perplexity is associated with later Still-thinking behavior, and that Still-thinking cases allocate more attention to the original question. Based on these observations, we propose an attention intervention method to regulate this behavior. While this intervention suppresses explicit thinking, it also causes a drop in accuracy, suggesting that the suppressed reasoning behavior is often useful for correctness. Our work provides confidence- and attention-level evidence for this behavior, highlighting the trade-off between instruction following, inference efficiency, and reasoning correctness.
Sources
- Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs
- Training Verifiers to Solve Math Word Problems
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
- Mathify: Evaluating Large Language Models on Mathematical Problem Solving Tasks
- Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models
- DeepSeek-V3 Technical Report
- The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities
- Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning
- Token-Budget-Aware LLM Reasoning
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models
- Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Models
- Syzygy of Thoughts: Improving LLM CoT with the Minimal Free Resolution
- Thought Manipulation: External Thought Can Be Efficient for Large Reasoning Models
- Chain of Draft: Thinking Faster by Writing Less
- Qwen2.5 Technical Report
- Reasoning Models Can Be Effective Without Thinking
- Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning
- s1: Simple test-time scaling
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems