Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compression
cs.AI
Submitted: 2026-09-23
Updated: 2026-09-23
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long horizon agents accumulate growing interaction histories that increase context and inference costs.
Terminology
Abstract
Long horizon agents accumulate growing interaction histories that increase context and inference costs. We find that geometric redundancy alone is an insufficient criterion for safe compression. Although agent histories exhibit strong low dimensional structure, similar global geometry can preserve very different amounts of task evidence. At identical retained block counts, evidence aware selection raises next action Top 3 retention from 0.31 to 0.69, while centroid similarity remains 0.98. Controlled replacement further shows that action related information can be substantially altered while global geometric measures remain nearly unchanged. Motivated by this gap between geometry and evidence, we introduce Geometry Guided Evidence Preserving Memory (GEM), a training free compressor that protects task and execution evidence before using geometric residuals to complete coverage. GEM reduces mean combined token usage from 2.69M to 2.11M per task, a 21.4% reduction, while maintaining comparable task reward. Our results show that efficient agent history compression should optimize for preserved task evidence rather than geometric coverage alone.
Sources
- ReAct: Synergizing Reasoning and Acting in Language Models
- ACON: Optimizing Context Compression for Long-horizon LLM Agents
- SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
- SWE-Pruner: Self-Adaptive Context Pruning for Coding Agents
- Self-Compacting Language Model Agents
- All-but-the-Top: Simple and Effective Postprocessing for Word Representations
- Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
- Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
- Self-GC: Self-Governing Context for Long-Horizon LLM Agents
- CoMem: Context Management with A Decoupled Long-Context Model
- ACM: Agentic Context Management for Long Horizon Tasks
- MemGPT: Towards LLMs as Operating Systems
- LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
- RULER: What's the Real Context Size of Your Long-Context Language Models?
- Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Construction
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- In-context Autoencoder for Context Compression in a Large Language Model
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems