A Dual-Path Architecture for Scaling Compute and Capacity in LLMs
cs.CL
Submitted: 2026-05-28
Updated: 2026-11-04
Terminology
Sources
- Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation
- PonderNet: Learning to Ponder
- Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
- Adaptive Computation Time for Recurrent Neural Networks
- LoopFormer: Elastic-Depth Looped Transformers for Latent Reasoning via Shortcut Modulation
- Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
- GLU Variants Improve Transformer
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset
- Augmenting Self-attention with Persistent Memory
- Scaling Latent Reasoning via Looped Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data