The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents
cs.AI
Submitted: 2026-09-26
Updated: 2026-09-26
Comments: 13 pages, 4 tables, no figures. A four-phase research program. Experiments executed and adversarially verified by PRIMA (arXiv:2605.24775); per-phase result files and preregistrations available to reviewers on request; certain mechanism internals held under controlled release (see Section 7)
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Long-horizon LLM agents must convert accumulated experience into durable memory, deciding what to keep, compress, abstract into reusable skills and rules, or forget.
Terminology
Abstract
Long-horizon LLM agents must convert accumulated experience into durable memory, deciding what to keep, compress, abstract into reusable skills and rules, or forget. We report a four-phase research program on this consolidation problem whose central finding is a shift in what is measured: from how much an agent remembers, to whether its consolidation decisions are any good, to whether those decisions can be trusted. Phase 1 learns episodic boundaries from agent traces by downstream utility; an honest near-miss (oracle correlation 0.691 vs a 0.70 bar) whose lasting output is a three-gate anti-leakage protocol. Phase 2 learns when to promote experience and to which abstraction level under a token budget, achieving a verified +22.7% task-success improvement with 7x compression, but exposing a degenerate-forgetting failure and a distribution-shift failure mode we name lambda-prevalence coupling. Phase 3 introduces ConsolidationBench, an oracle-by-construction benchmark that scores consolidation decisions against a known optimum on three non-circular axes; production retrieval systems retain information yet score zero on cross-level transfer. Phase 4 introduces governed consolidation: the decision wrapped in poison-resistance, reversibility, and auditability guarantees with a quality gate. Governance is statistically distinct from the quality score (r squared = 0.43; partial r = 0.27; identical-quality policies differ threefold in governance), so the contribution survives independently of the metric's external validity. On that question we report a resolved negative: after a graded-reuse redesign removed a structural ceiling, a two-benchmark study with 2,532 real answer cells finds the quality score does not predict real transfer accuracy (pooled Spearman ρ= -0.24, n = 12, CI spanning zero). An adversarial self-critique pass cleared the final claim set with zero surviving overclaims.
Sources
- Human-inspired Episodic Memory for Infinite Context LLMs
- HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
- MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
- Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
- TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents
- Generative Agents: Interactive Simulacra of Human Behavior
- Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMs
- LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
- AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems