Rectified Looped Transformer
cs.LG, cs.AI
Submitted: 2026-11-12
Updated: 2026-11-13
Terminology
Sources
- LoopMoE: Unifying Iterative Computation with Mixture-of-Experts for Language Modeling
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- The Pile: An 800GB Dataset of Diverse Text for Language Modeling
- Loop the Loopies!
- Unrolled Flow Models for Reasoning
- One Model to Loop Them All: Elastic Latent Recurrence for Language Models
- Sparse Layers are Critical to Scaling Looped Language Models
- Decoding Looped Transformers Better for (Almost) Free
- Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformers
- Thinking with Looped Flows
- Scheduling Recursive Reasoning in Looped Transformers
- Improving Test-Time Scaling with Adaptive Looped Transformers
- Scaling Latent Reasoning via Looped Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis