Judged Useless, Queried Anyway: Tool-Using Agents Rarely Turn Their Own Evidence Judgments into Stopping Decisions
cs.AI, cs.CL
Submitted: 2026-10-05
Updated: 2026-10-05
Comments: 37 pages, 6 figures, 28 tables. Code: https://github.com/bennidict23/judged-useless-queried-anyway
Code: https://github.com/bennidict23/judged-useless-queried-anyway
License: http://creativecommons.org/licenses/by/4.0/
The gist: An agent whose tool keeps returning nothing useful should stop relying on it.
Abstract
An agent whose tool keeps returning nothing useful should stop relying on it. In a retrieval environment with controlled source failures, we separate how agents judge results from what they do. We compare stopping at the same step after longer and shorter runs of results the agent judged useless; this contrast is zero for clock- or deadline-driven stopping. Where we record their judgments, the seven agents we test call a failing source's results useless 97-100% of the time, yet most of them rarely stop on that judgment. Prompt cues change when they stop but not what they stop on. Permission to answer from memory and a reasoning mode can bring early stops regardless of evidence, a stated budget moves the 7-8B models' stops to the deadline, and a stopping rule or call cost in the prompt is followed at most partly. Stopping follows the evidence only when the harness enforces an integration step that makes the agent answer after five consecutive results it judged useless. This step raises failing-source success for every model, keeps the stopping point fixed when the budget doubles, and needs no extra judgment call when the agent states its judgments. A pre-registered replication on 300 fresh questions confirms the dissociation and the rule's effect.
Sources
- Bench2Robust: Scenario-Controlled Recovery for Tool-Using Agents
- The Llama 3 Herd of Models
- Language Models (Mostly) Know What They Know
- From Knowing to Acting: Benchmarking Self-Awareness Capability of LLM Agents
- When May an Agent Stop? Evidence-Carrying Termination for Tool-Using LLMs
- Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agents
- AgentAbstain: Do LLM Agents Know When Not to Act?
- Agentic Abstention: Do Agents Know When to Stop Instead of Act?
- Qwen2.5 Technical Report
- HALT: Verification-Aware Stopping for Retrieval-Augmented Search Agents
- Corrective Retrieval Augmented Generation
- Qwen3 Technical Report
- Agents' Overreliance on Unreliable Tools
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems