Latent-Condensed Transformer for Efficient Long Context Modeling
cs.CL
Submitted: 2026-04-14
Updated: 2026-11-03
Terminology
Sources
- Program Synthesis with Large Language Models
- LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
- Longformer: The Long-Document Transformer
- Training Verifiers to Solve Math Word Problems
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
- LongNet: Scaling Transformers to 1,000,000,000 Tokens
- Data Engineering for Scaling Language Models to 128K Context
- The Llama 3 Herd of Models
- RULER: What's the Real Context Size of Your Long-Context Language Models?
- MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
- Kimi Linear: An Expressive, Efficient Attention Architecture
- DeepSeek-V3 Technical Report
- Fast Transformer Decoding: One Write-Head is All You Need
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data