Dissecting Geometric Constraints in Grokking: Interaction-Dependent Acceleration in Modular Arithmetic
cs.LG, cs.CC
Submitted: 2026-11-02
Updated: 2026-11-02
Terminology
Sources
- What Makes a Representational Prior Work? Feature Families, Label-Free Invariances, and Critical Windows in Grokking
- Post-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformers
- How to Tame Grokking: Representation Geometry as a Control Signal
- Omnigrok: Grokking Beyond Algorithmic Data
- A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks
- Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition
- Grokking Is Conditional and Fragile: A Fully-Tractable, Multi-Seed Study at 12K Parameters
- Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets
- Explaining Grokking in Transformers through the Lens of Inductive Bias
- Radial Suppression Accelerates Algorithmic Generalization: A Geometric Analysis of Delayed Generalization
- Cross-Trajectory Chimera Interventions Reveal Dissociable Roles of Weight Magnitude and Direction in Grokking
- At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics
- Explaining grokking through circuit efficiency
- The Active Ingredient in Muon's Grokking
- The Geometric Inductive Bias of Grokking: Bypassing Phase Transitions via Architectural Topology
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis