Scalaris: A Scalable Enterprise Memory Architecture for Conversational AI Assistants
cs.CL, cs.AI
Submitted: 2026-11-02
Updated: 2026-11-02
Comments: Paper Under Review
License: http://creativecommons.org/licenses/by/4.0/
The gist: Enterprise conversational systems require memory to personalize interactions, retain information across sessions, and maintain conversational coherence.
Terminology
Abstract
Enterprise conversational systems require memory to personalize interactions, retain information across sessions, and maintain conversational coherence. At enterprise scale, however, memory must not only retrieve relevant information accurately but also provide it efficiently to the answer-generation model. Existing memory systems face a trade-off between retrieval accuracy and context efficiency. Retrieving more context can improve recall but increases inference cost and latency. We present Scalaris, a scalable enterprise memory architecture that addresses this trade-off through a unified long-term and short-term memory design. We propose that user interactions and assistant responses possess distinct characteristics and roles in a conversation: user interactions capture evolving knowledge about the user and provide value across sessions, whereas assistant responses must be stored efficiently so that only information relevant to the current query is retrieved. We therefore treat them separately and support each with specialized representations and ingestion/retrieval pipelines. Scalaris reaches 92.2 % accuracy on LongMemEval-S and 90.77 % on LoCoMo using Qwen3-32B, state-of-the-art results on both benchmarks, while supplying the answer-generation model with approximately 10 times fewer retrieved context tokens than Hindsight, a leading memory system for conversational AI. When integrated with our proprietary closed-source AI assistants, Scalaris improved overall response quality by 36 %. Together, these results establish Scalaris as a cost-effective framework for building scalable, personalized conversational AI systems.
Sources
- Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflects
- GPT-4o System Card
- gpt-oss-120b & gpt-oss-20b Model Card
- MemGPT: Towards LLMs as Operating Systems
- Qwen3 Technical Report
- Zep: A Temporal Knowledge Graph Architecture for Agent Memory
- From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
- Zero-Mem: Zero-Token Memory Operations for LLM Agents
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data