What drives the emergence of symbolic mechanisms in large language models?
cs.CL
Submitted: 2026-11-09
Updated: 2026-11-09
Terminology
Sources
- Approximation of relation functions and attention mechanisms
- Evaluating the Robustness of Analogical Reasoning in Large Language Models
- Tracing the Representation Geometry of Language Models from Pretraining to Post-training
- Progress measures for grokking via mechanistic interpretability
- In-context Learning and Induction Heads
- Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets
- Does Data Scaling Lead to Visual Compositional Generalization?
- Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data