LooM: Loop-Invariant Memory for Causal Encoder-Decoder Language Models
cs.CL
Submitted: 2026-11-04
Updated: 2026-11-04
Terminology
Sources
- Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation
- PonderNet: Learning to Ponder
- SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
- Training-Free Looped Transformers
- LoopMoE: Unifying Iterative Computation with Mixture-of-Experts for Language Modeling
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inference
- Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
- Adaptive Computation Time for Recurrent Neural Networks
- Looping Beyond Twice: A Scalable Recipe for Looped Mixture-of-Experts
- Dr.LLM: Dynamic Layer Routing in LLMs
- Towards Looped Models Done Right, Part II: Rethinking at Fixed Points
- LoopFormer: Elastic-Depth Looped Transformers for Latent Reasoning via Shortcut Modulation
- Asymmetric Looped Transformers: Fixed Global Representations for an Iterative Decoder
- Looped Latent Attention: Cross-Loop KV Compression for Looped Transformers
- BeNice! Closing Looping's Inference-Memory Gap via KV-Sharing
- Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
- mHC: Manifold-Constrained Hyper-Connections
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data