Re-derivability Decides What a Staged Agent Pipeline Recovers After an Upstream Fault
cs.AI, cs.CL, cs.LG
Submitted: 2026-09-26
Updated: 2026-09-26
Comments: 34 pages, 8 figures, 13 tables; preprint under review
License: http://creativecommons.org/licenses/by/4.0/
The gist: One variable sets what an upstream fault costs a staged pipeline of language-model agents: re-derivability, how much of what a stage needs it can rebuild from the original problem.
Terminology
Abstract
One variable sets what an upstream fault costs a staged pipeline of language-model agents: re-derivability, how much of what a stage needs it can rebuild from the original problem. Grounding an inspector agent in that problem is worth +0.608 [+0.517, +0.700] to +0.358 over a blind one on four open-weight backbones served with thinking disabled, and on the two Qwen backbones the blind inspector changes no item at all. That head-to-head is exploratory. One deterministic fault enters the first stage, and we re-expose the original problem to k = 0,,3 of the downstream stages with agents, items, fault and topology held fixed, on 120 gsm hard items per arm at temperature zero. Accuracy under fault rises on four of four backbones, from +0.233 to +0.392, the largest Holm-adjusted p being 2.1 times10-6. A registered kill test rules out tokens. Blanking every word holds the word slots fixed, and retention tracks the visible fraction on four of four, climbing from 0.221 to 0.692 on the primary. Those two families are confirmatory and everything else here is exploratory. The interaction excludes zero on two of four backbones under the registered pipeline, four of four under a three-stage pipeline, and three of four under full message history, the primary at +0.317. On Llama-3.1-8B the fault carries no detectable cost at any dose, so the other three carry every claim about what a fault costs. Re-derivability also sets what the architecture costs, and no decomposition we measured reliably beats one direct call. With no fault injected the registered pipeline loses to that call by-0.267, -0.125 and-0.317, and on Phi-4 reads +0.058 at p = 0.118, which the test fails to separate from zero. The repair that works is cheap and front-loaded: the first re-grounded stage buys +0.394 of matched retention for +59.8 tokens per item on Qwen3-14B, and the stages after it buy nothing.
Sources
- Phi-4 Technical Report
- Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents
- Adversarial Attacks in Multi-Agent LLM Pipelines: Unveiling Structural Vulnerabilities in Agentic AI Architectures
- Beyond Single-Agent Safety: A Taxonomy of Risks in LLM-to-LLM Interactions
- Why Do Multi-Agent LLM Systems Fail?
- Training Verifiers to Solve Math Word Problems
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- Faith and Fate: Limits of Transformers on Compositionality
- Byzantine Cheap Talk: Adversarial Resilience and Topology Effects in LLM Coordination Games
- PAL: Program-aided Language Models
- The Llama 3 Herd of Models
- Measuring Massive Multitask Language Understanding
- Measuring Mathematical Problem Solving With the MATH Dataset
- MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
- On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents
- Large Language Models Cannot Self-Correct Reasoning Yet
- MAS-FIRE: Fault Injection and Reliability Evaluation for LLM-Based Multi-Agent Systems
- Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models
- Byzantine-Robust Decentralized Coordination of LLM Agents
- On the risk of coding before testing: An empirical study on LLM-based test generation workflow
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems