DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention
cs.AI, cs.CL
Submitted: 2026-10-30
Updated: 2026-11-03
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- DeciMamba: Exploring the Length Extrapolation Potential of Mamba
- Optimal Decay Spectra for Linear Recurrences
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention
- RULER: What's the Real Context Size of Your Long-Context Language Models?
- Kimi Linear: An Expressive, Efficient Attention Architecture
- RWKV-7 "Goose" with Expressive Dynamic State Evolution
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents