Recoverability Has a Law: The ERR Measure for Tool-Augmented Agents
cs.LG, cs.AI
Submitted: 2026-01-29
Updated: 2026-10-02
Comments: Preprint for ICML Submission
License: http://creativecommons.org/licenses/by/4.0/
The gist: Language model agents often appear capable of self-recovery after failing tool call executions, yet this behavior lacks a formal explanation.
Terminology
Abstract
Language model agents often appear capable of self-recovery after failing tool call executions, yet this behavior lacks a formal explanation. We present a predictive theory that resolves this gap by showing that recoverability follows a measurable law. To elaborate, we formalize recoverability through Expected Recovery Regret (ERR), which quantifies the deviation of a recovery policy from the optimal one under stochastic execution noise, and derive a first-order relationship between ERR and an empirical observable quantity, the Efficiency Score (ES). This yields a falsifiable first-order quantitative law of recovery dynamics in tool-using agents. We empirically validate the law across five tool-use benchmarks spanning controlled perturbations, diagnostic reasoning, and real-world APIs. Across model scales, perturbation regimes, and recovery horizons, predicted regret under the ERR-ES law closely matched observed post-failure regret measured from Monte Carlo rollouts, within delta less than or equal to 0.05. Our results reveal that recoverability is not an artifact of model scale or architecture, but a governed property of interaction dynamics, providing a theoretical foundation for execution-level robustness in language agents.
Sources
- Policy Gradients with Variance Related Risk Criteria
- Explaining and Harnessing Adversarial Examples
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
- API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- Reflexion: Language Agents with Verbal Reinforcement Learning
- PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Cases
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks