delta-mem: Efficient Online Memory for Large Language Models
δ-mem introduces a lightweight memory system that adds an online associative memory to frozen large language models. It compresses past information into a compact state and uses this state to dynamically steer the model's attention during generation. This allows the model to effectively use long-term context without needing expensive context extensions or backbone changes.