Beyond Instruction Following: Learning Grounded Skill-Following with Skill Contracts
cs.AI
Submitted: 2026-10-04
Updated: 2026-10-04
Code: https://github.com/MrToser/skill-following
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Instruction following typically enforces discrete, response-level requirements, whereas an expert-authored skill prescribes procedural requirements spanning multiple phases and environment
Abstract
Instruction following typically enforces discrete, response-level requirements, whereas an expert-authored skill prescribes procedural requirements spanning multiple phases and environment interactions. Given such a skill, we train the executor to execute all required phases instead of focusing solely on the final answer. We therefore introduce Grounded Skill-Following, which requires an agent to execute a fixed, expert-authored skill across its required phases by grounding decisions in environment observations. To achieve verifiable procedural execution, we formulate each skill as a skill contract combining visible skill instructions with an explicit contract runtime. The runtime specifies required phases, admissible actions, permitted transitions, and accepted termination. This structure provides a dense, verifiable training signal throughout execution. We leverage this by introducing Verified Progress Credit, which assigns rewards upon the initial completion of contract milestones and aggregates them into the trajectory return to guide policy optimization. During rollout, the contract runtime continuously tracks state transitions to provide Contract-State Feedback, which indicates whether the latest action is accepted and guides the agent toward valid next actions. To measure procedural compliance, we introduce the Protocol Completion Rate (PCR), defined as reaching accepted termination through all required phases, and decouple it from the final Task Outcome. Jointly trained with our framework, Qwen3.5-4B achieves Protocol Completion Rates of 99.27% on Math and 99.96% on Search, while slightly outperforming original baselines in Task Outcome (82.95% and 46.61%, respectively). Controlled studies examine how skill instructions, training signals, and contract-state feedback affect both metrics, while withholding interventions evaluate behavioral dependence on observation content.
Sources
- Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
- Training Verifiers to Solve Math Word Problems
- SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models
- Measuring Mathematical Problem Solving With the MATH Dataset
- Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents
- An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agents
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- SKILLC: Learning Autonomous Skill Internalization in LLM Agents via Contrastive Credit Assignment
- Harnessing LLM Agents with Skill Programs
- SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization
- Proof-of-Use: Mitigating Tool-Call Hacking in Deep Research Agents
- WebGPT: Browser-assisted question-answering with human feedback
- Multitask Prompted Training Enables Zero-Shot Task Generalization
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Skill1: Unified Evolution of Skill-Augmented Agents via Reinforcement Learning
- Skill Retrieval Augmentation for Agentic AI
- SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
- SynCode: LLM Generation with Grammar Augmentation
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- Skill-SD: Skill-Conditioned Self-Distillation for Multi-turn LLM Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems