Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models
MELT decouples reasoning depth from memory consumption by sharing a single KV cache per layer across reasoning loops. It achieves constant-memory iterative reasoning, recovering the footprint of non-looped transformers while maintaining LoopLM performance through a learnable gating mechanism.