Loop Before You Leap: What Recurrent Depth Can and Cannot Buy in Data-Limited Pretraining
cs.CL, cs.LG
Submitted: 2026-11-04
Updated: 2026-11-04
Terminology
Sources
- BabyLM Turns 4 and Goes Multilingual: Call for Papers for the 2026 BabyLM Workshop
- How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models
- LLaMA: Open and Efficient Foundation Language Models
- Looping Back to Move Forward: Recursive Transformers for Efficient and Flexible Large Multimodal Models
- Multimodal Latent Reasoning via Hierarchical Visual Cues Injection
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data