Worse Together: How Performance Breaks Down in Multi-User Multi-Agent Teams
cs.AI
Submitted: 2026-09-30
Updated: 2026-09-30
Comments: 63 pages, 22 Figures, 10 Tables, Code: https://github.com/safety-research/MAMUBench (will be released after review)
Code: https://github.com/safety-research/MAMUBench
Project page: https://www.reuters.com/world/europe/openai-agents-hijackedgerman-website-previously-undisclosed-ai-breakout-this-2026-09-04
License: http://creativecommons.org/licenses/by/4.0/
The gist: People are increasingly delegating tasks to AI agents, and those agents are increasingly encountering other people's agents over shared resources such as a codebase, a calendar, or a budget.
Abstract
People are increasingly delegating tasks to AI agents, and those agents are increasingly encountering other people's agents over shared resources such as a codebase, a calendar, or a budget. When each agent acts for a different user with different goals, coordination often fails, and the group ends up worse off than if a single agent had acted for everyone. We study this multi-user, multi-agent setting across five frontier models and 77 scenarios in four environments: an API key environment in which agents share a compute budget, a clinic in which they share a calendar, a personal assistant environment in which they share a group order or booking, and a merge queue in which they share a release cutoff. In each scenario, we compare a single agent that serves every user (a coordinator) to a team in which each agent serves one user, with and without a communication channel between the agents. Teams deliver worse group outcomes than the coordinator in every environment: without a channel, they completely collapse in two environments, and even with one, coordination overhead creates substantial gaps. For example, in the personal assistant environment, the coordinator fulfills a targeted user request about twice as often as teams. We identify distinct behaviors associated with this poor group-level performance, including stalling as teams grow, overriding each other's actions, and fabricating claims. We find effective but environment-specific mitigations, such as a team lead, explicit procedural instructions, and a platform check that makes an agent read its peers' messages before committing. We will release the API key, clinic, and personal assistant environments as MAMUBench, comprising 74 scenarios for evaluating multi-user, multi-agent coordination.
Sources
- LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models
- Self-Resource Allocation in Multi-Agent LLM Systems
- Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets
- Why Do Multi-Agent LLM Systems Fail?
- Multi-Agent Risks from Advanced AI
- DPBench: Structural Determinants of Multi-Agent LLM Coordination Under Simultaneous Resource Contention
- A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems
- Language Agents as Digital Representatives in Collective Decision-Making
- Towards a Science of Scaling Agent Systems
- More Agents Is All You Need
- Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents
- Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control
- AI Organizations are More Effective but Less Aligned than Individual Agents
- CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas
- Mixture-of-Agents Enhances Large Language Model Capabilities
- Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
- Multi-User Large Language Model Agents
- MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
- CalBench: Evaluating Coordination-Privacy Trade-offs in Multi-Agent LLMs
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems