POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents
cs.AI, cs.CL
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: Accepted Findings of AACL-IJCNLP 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM tool-use agents operate in dynamic environments where many actions carry operational risk.
Terminology
Abstract
LLM tool-use agents operate in dynamic environments where many actions carry operational risk. However, most safety mechanisms react only after errors manifest. Existing pre-emptive approaches either fine-tune the agent on chain-of-thought deliberation or compile natural-language guardrails into runtime checks, but they do so without exposing a structural, auditable verdict. We propose POLAR, a guardrail framework for small tool-calling agents that assesses reversibility through a structured two-layer ontology. POLAR assigns each action a graded reversibility score by deriving a candidate inverse sequence; calls failing a threshold are pruned before execution. Evaluated on τ squared-bench across six agent models, POLAR improves mean task reward by 0.11 to 0.18 points on airline for four of six agents, but only eight of eighteen model--domain cells improve overall; retail and stronger agents often regress. POLAR provides an auditable structural check and characterizes its task-utility trade-offs. Reward is not a direct measure of prevented harm.
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning
- Leave no Trace: Learning to Reset for Safe and Autonomous Reinforcement Learning
- LLM+P: Empowering Large Language Models with Optimal Planning Proficiency
- SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs
- GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning
- ReAct: Synergizing Reasoning and Acting in Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems