Don't Offer What Can't Be Done: Deterministic Executability Gating for LLM Skill Selection at Scale

arXiv:2608.01050 · cs.AI, cs.CL, cs.SE · Submitted 2026-08-02 · Read on arXiv

Ortal Ashkenazi, Vitalii Kloz, Mykhailo Ulianchenko

cs.AI, cs.CL, cs.SE

Submitted: 2026-08-02

Comments: 7 pages, 3 figures. Preprint. Submitted to the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2027), Applied Data Science Track; currently under review

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• International Conference on Machine Learning — 6× in this paper
• Benchmark — 5× in this paper · explained in 2 episodes
• RAG — 5× in this paper · explained in 3 episodes
• Failure Modes — 3× in this paper · explained in 3 episodes
• AI Agents — 2× in this paper · explained in 2 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Generative AI — 2× in this paper · explained in 2 episodes
• Pruning — 2× in this paper · explained in 4 episodes
• Abstention — 1× in this paper · explained in 1 episode
• Accountability — 1× in this paper · explained in 2 episodes
• Agentic Reasoning — 1× in this paper · explained in 2 episodes
• Benchmarking — 1× in this paper · explained in 4 episodes
• Berkeley Function Calling Leaderboard — 1× in this paper
• Clarity — 1× in this paper · explained in 3 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• In International Conference on Learning Representations — 1× in this paper
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Use
• Contract2Tool: Learning Preconditions and Effects for Reliable Tool-Augmented LLM Agents
• ToolChoiceConfusion: Causal Minimal Tool Filtering for Reliable LLM Agents
• ToolMenuBench: Benchmarking Tool-Menu Filtering Strategies for Reliable and Efficient LLM Agents
• GIST-CMTF: Goal-State Inference for Causal Minimal Tool Filtering in LLM Agents
• WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation
• RAGXplain: From Explainable Evaluation to Actionable Guidance of RAG Pipelines
• RAG-MCP: Mitigating Prompt Bloat in LLM Tool Selection via Retrieval-Augmented Generation
• Are Your Agents Upward Deceivers?
• LongFuncEval: Measuring the effectiveness of long context models for function calling
• Toolshed: Scale Tool-Equipped Agents with Advanced RAG-Tool Fusion and Tool Knowledge Bases
• When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agents
• Reason Less, Verify More: Deterministic Gates Recover a Silent Policy-Violation Failure Mode in Tool-Using LLM Agents
• Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents
• Agentic Model Checking
• Prompt Injection as Role Confusion

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• Agents' Last Exam
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems