A Closer Look at Language Model Introspection: Probing Information and Reporting
cs.CL
Submitted: 2026-11-11
Updated: 2026-11-14
Terminology
Sources
- Language models recognize dropout and Gaussian noise applied to their activations
- Introspection Fine-Tuning (IFT): Training Small LLMs to Introspect
- Emergent Introspection in AI is Content-Agnostic
- Emergent Introspective Awareness in Large Language Models
- Mechanisms of Introspective Awareness
- Can LLMs Introspect? A Reality Check
- Interventional Training Reduces Causal Bypass in In-Context Introspection
- Olmo 3
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data