Knowledge-Based Zero-Replay Debugging of Multi-Agent LLM Traces
cs.SE, cs.AI
Submitted: 2026-06-11
Updated: 2026-09-26
Comments: 21 pages, 1 figure, 6 tables. Submitted to Knowledge-Based Systems
License: http://creativecommons.org/licenses/by/4.0/
The gist: Reliable operation of multi-agent large language model (LLM) systems depends on debugging long execution traces, where the few causally decisive events are buried in unstructured logs of messages,
Terminology
Abstract
Reliable operation of multi-agent large language model (LLM) systems depends on debugging long execution traces, where the few causally decisive events are buried in unstructured logs of messages, routes, memory writes, and tool calls. The standard tool is counterfactual replay (rewind, edit, and re-run the trajectory to measure each event's effect), but its cost grows linearly with the number of candidate events, making exhaustive replay infeasible at scale. We frame trace debugging as a knowledge-based decision-support problem. Each trace is compiled into a structured event knowledge graph over routing, memory, tool-use, uncertainty, and latent evidence, and a calibrated predictor decides where a scarce replay budget should be spent. We do not propose a new replay oracle; we propose a method to predict its results without paying the replay cost. We formulate zero-replay counterfactual-effect prediction: given a trace under a fixed budget, predict which events the oracle would mark high-effect before any replay is performed. BranchPoint-Latent is a lightweight predictor over observable, structural, uncertainty, and latent features of the knowledge graph. Calibrated against a deterministic replay oracle across 37 trace families, a single learning-to-rank gradient-boosted predictor raises per-trace localization (Branch Recall@5) from 0.73 to 0.93 on held-out families at zero oracle-replay cost. Rather than claiming universal dominance, we characterize when cheap graph centrality suffices and when learned evidence is necessary. The result is an auditable, cost-efficient decision-support system for AI-reliability debugging, positioned explicitly on the cost-accuracy frontier with reproducible artifacts.
Sources
- Interactive Debugging and Steering of Multi-Agent AI Systems
- WhatIf: Interactive Exploration of LLM-Powered Social Simulations for Policy Reasoning
- DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems
- Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems
- TRAIL: Trace Reasoning and Agentic Issue Localization
- Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
- MASPrism: Lightweight Failure Attribution for Multi-Agent Systems Using Prefill-Stage Signals
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- ReAct: Synergizing Reasoning and Acting in Language Models
- Toolformer: Language Models Can Teach Themselves to Use Tools
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- Reflexion: Language Agents with Verbal Reinforcement Learning
- Generative Agents: Interactive Simulacra of Human Behavior
- CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
- Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies
- Training Verifiers to Solve Math Word Problems
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
Related papers
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
- PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
- IntentCoding: Amplifying User Intent in Code Generation
- Incentives and Outcomes in Bug Bounties