Remember Before You're Asked: MemDream for Self-Probing Memory Evolution
cs.AI
Submitted: 2026-09-28
Updated: 2026-09-28
License: http://creativecommons.org/licenses/by/4.0/
The gist: Memory is essential for enabling LLM-based agents to maintain coherent, personalized behavior over long-horizon interactions.
Abstract
Memory is essential for enabling LLM-based agents to maintain coherent, personalized behavior over long-horizon interactions. However, existing memory systems share a fundamental limitation: they never proactively test their own memory, repairing it only after real queries expose weaknesses. This reactive paradigm means every retrieval failure corresponds to a real interaction in which the cost has already been paid. We propose MemDream, a framework that enables self-probing memory evolution for LLM agents. Our framework periodically enters offline dream cycles where three specialized agents (Dreamer, Analyst, Consolidator) collaboratively probe, diagnose, and repair the memory graph before failures occur. A policy trained via Group Relative Policy Optimization learns which repair operations produce durable retrieval improvements, while a soft decay mechanism provides reversible forgetting driven by the same anticipatory signal. Experiments on LoCoMo and MemoryAgentBench demonstrate that MemDream improves answer F1 by 4.5 points on LoCoMo and achieves a 9.1-point higher overall score on MAB over the strongest reactive-evolution baselines.
Sources
- FLEX: Continuous Agent Evolution via Forward Learning from Experience
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- Larimar: Large Language Models with Episodic Memory Control
- MemR$^3$: Memory Retrieval via Reflective Reasoning for LLM Agents
- From Local to Global: A Graph RAG Approach to Query-Focused Summarization
- Retrieval-Augmented Generation for Large Language Models: A Survey
- FSFM: A Biologically-Inspired Framework for Selective Forgetting of Agent Memory
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
- MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents
- Memory OS of AI Agent
- Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security
- MemOS: A Memory OS for AI System
- EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents
- PREF-Gate: Provenance-Constrained Relational Evidence Fusion with Validation-Gated Selection for Graph Fraud Detection
- Diagnose Before You Compress: Prediction-Independent Bottleneck Witness Refinement for LLM Serving Traces
- Choosing How to Remember: Adaptive Memory Structures for LLM Agents
- From Newborn to Impact: Bias-Aware Citation Prediction
- Zep: A Temporal Knowledge Graph Architecture for Agent Memory
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems