Safe Skill Retirement for Physical Agents
cs.AI
Submitted: 2026-08-25
Updated: 2026-08-25
Comments: Submitted to the Special Track on AI Alignment of the Forty-First AAAI Conference on Artificial Intelligence (AAAI-27); currently under review
License: http://creativecommons.org/licenses/by/4.0/
The gist: Agent skills bundle procedural guidance with execution conditions governing authority, user consent, and live environment state.
Terminology
Abstract
Agent skills bundle procedural guidance with execution conditions governing authority, user consent, and live environment state. When model capabilities advance, maintainers prune instructions that appear redundant on authorized benchmark tasks. However, authorized maintenance tests can leave dormant safety conditions untested. This mismatch creates an unmeasured support gap over physical and privacy-sensitive effects. We introduce matched authority counterfactuals that hold the requested action, tool parameters, and intended effect fixed while systematically varying a single governing predicate. We formalize this evaluation via a two-gate retirement certificate requiring a candidate reduction to preserve authorized utility within a declared margin while producing zero unauthorized protected effects. In controlled experiments spanning four frontier and local model configurations across twelve skill bundles (2,592 evaluation cells), task-certified reductions remove over 94% of skill clauses and preserve authorized completion, yet produce unauthorized protected effects in every bundle. Boundary enforcement eliminates protected effects on the declared audit but fails the utility gate for one configuration. One bounded combined protocol passes both gates across all four configurations, with zero utility headroom. An end-to-end check on one read-only Home Assistant camera chain verifies proposal, decision, and effect measurements on a real device. These results demonstrate that while task benchmarks can justify retiring procedural guidance, retirement decisions require explicitly auditing the authority contracts governing physical actions.
Sources
- Defeating Prompt Injections by Design
- SkillReducer: Optimizing LLM Agent Skills for Token Efficiency
- SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement
- Gemma 4 Technical Report
- SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
- Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
- Reason Less, Verify More: Deterministic Gates Recover a Silent Policy-Violation Failure Mode in Tool-Using LLM Agents
- SAGE: Smart home Agent with Grounded Execution
- Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- Beyond OAuth: Task-Scoped Authorization for AI Agents via Natural Language Slices
- Progent: Securing AI Agents with Privilege Control
- SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems