Copies or Sources? Measuring How LLM Aggregators Count Restated Evidence in Multi-Agent Systems
cs.AI
Submitted: 2026-10-05
Updated: 2026-10-05
Code: https://github.com/zozo123/GULI-SET
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Multi-agent systems built on large language models (LLMs) restate observations as a matter of course: relays forward them, shared boards repeat them and discussion rounds echo them.
Terminology
Abstract
Multi-agent systems built on large language models (LLMs) restate observations as a matter of course: relays forward them, shared boards repeat them and discussion rounds echo them. An aggregator that pools such messages should count sources, not statements. We convert a reported probability into units of independent readings, which assigns every restatement a copy weight, 0 for an aggregator that counts sources and 1 for one that counts every statement, and yields the implied decision under any cost structure. Three testbeds hold the evidence fixed and vary how it is restated: message logs with an exact Bayesian oracle, web documents with appended copies, and logs written by LLM agent teams under four communication protocols. Across four models from three providers, a forwarded copy counts for 0.06 to 0.42 of a new reading, mostly because some replies count every statement. On 5% to 40% of logs that state one reading three times, the reported belief implies an early commitment that the oracle never makes. The models that count copies least and most on controlled logs do so on web copies and agent-written logs as well. A one-paragraph declaration of what a copy contributes brings the copy weight on controlled logs to 0.08 or less. A rule that has agents refer to readings instead of restating them cuts belief-implied early commitment from 11.2% to 1.1% and preserves genuine corroboration.
Sources
- SemDeDup: Data-efficient learning at web-scale through semantic deduplication
- Epistemic Sybil Resistance: Multiplying AI Agents Without Multiplying Evidence
- MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraft
- Testing Interchangeability in LLM Agent Teams
- Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels
- Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
- Auditing Provenance Sensitivity in LLM Agent Action Selection
- Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
- GraphEcho: Structural Redundancy and Evidence Provenance in LLM Graph Agents
- MAP-Graph: Provenance-Aware Shared Memory for Multi-Agent Workflows
- When Truth Is Distributed: Misinformation Derails Collective Fact Recovery in LLM-Based Multi-Agent Systems
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems