RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
cs.CL, cs.AI, cs.MA
Submitted: 2025-08-06
Updated: 2026-10-12
Code: https://github.com/assafelovic/gpt-researcherh
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks.
Terminology
Abstract
Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks. However, scaling such systems can substantially increase inference cost, especially when multiple agents repeatedly process overlapping or role-irrelevant context. Many existing multi-agent frameworks focus on orchestration and role specialization, but still rely on full-context sharing or static context routing, leading to redundant token consumption, increased runtime, and inefficient memory utilization. We present Role-Conditioned Context Routing (RCR), an execution-time layer that allocates role-relevant shared-memory items to agents under token budgets. Given a structured shared memory and a set of role-specialized agents, RCR selectively routes task-relevant memory items to each agent according to its role, optional task-stage metadata, and token budget. RCR integrates role-conditioned relevance scoring, token-budgeted memory selection, and iterative memory updates to reduce redundant context exposure during multi-agent execution. Experiments on multi-hop QA, embodied reasoning (ALFWorld), and web-based decision-making (WebShop) show that RCR reduces token usage by 35% on average and runtime by 38% on average relative to Full-Context, while maintaining or improving task performance.
Sources
- GPT-4 Technical Report
- AgentScope: A Flexible yet Robust Multi-Agent Platform
- TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools
- LLM Multi-Agent Systems: Challenges and Open Problems
- MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
- HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model
- Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality
- Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applications
- MAC: ModAlity Calibration for Object Detection
- From Local Cues to Global Percepts: Emergent Gestalt Organization in Self-Supervised Vision Models
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
- Structured Agent Distillation for Large Language Model
- Brain Tumor Classification on MRI in Light of Molecular Markers
- DeepSeek-VL: Towards Real-World Vision-Language Understanding
- AIOS: LLM Agent Operating System
- Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
- Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
- Gemini: A Family of Highly Capable Multimodal Models
- LLaMA: Open and Efficient Foundation Language Models
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering