RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

arXiv:2508.04903 · cs.CL, cs.AI, cs.MA · Submitted 2025-08-06 · Read on arXiv

cs.CL, cs.AI, cs.MA

Submitted: 2025-08-06

Updated: 2026-10-12

Code: https://github.com/assafelovic/gpt-researcherh

License: http://creativecommons.org/licenses/by/4.0/

The gist: Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks.

Terminology

Abstract

Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks. However, scaling such systems can substantially increase inference cost, especially when multiple agents repeatedly process overlapping or role-irrelevant context. Many existing multi-agent frameworks focus on orchestration and role specialization, but still rely on full-context sharing or static context routing, leading to redundant token consumption, increased runtime, and inefficient memory utilization. We present Role-Conditioned Context Routing (RCR), an execution-time layer that allocates role-relevant shared-memory items to agents under token budgets. Given a structured shared memory and a set of role-specialized agents, RCR selectively routes task-relevant memory items to each agent according to its role, optional task-stage metadata, and token budget. RCR integrates role-conditioned relevance scoring, token-budgeted memory selection, and iterative memory updates to reduce redundant context exposure during multi-agent execution. Experiments on multi-hop QA, embodied reasoning (ALFWorld), and web-based decision-making (WebShop) show that RCR reduces token usage by 35% on average and runtime by 38% on average relative to Full-Context, while maintaining or improving task performance.

Sources

Related papers