CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks
cs.RO, cs.CV
Submitted: 2026-10-05
Updated: 2026-10-12
License: http://creativecommons.org/licenses/by/4.0/
The gist: Household robots must accommodate new user instructions while executing ongoing tasks.
Abstract
Household robots must accommodate new user instructions while executing ongoing tasks. Existing agents often regenerate or extensively revise the remaining task sequence, introducing plan ambiguity, logical inconsistency, and redundant execution. We formulate continual instruction reconciliation and propose CIRRA (Continual Instruction Reconciliation for Robot Agents), a dual-level framework combining LLM-based semantic reasoning with rule-constrained structural integration. CIRRA first grounds incoming instructions to unique executable skills and resolves underspecified actions and execution locations. It then preserves the ongoing subtask sequence as an execution backbone and generates integration candidates by inserting incoming subtasks into location-matched segments. The semantic reasoner evaluates only modified segments to identify dependencies and conflicts and select the most logically coherent local integration. This structure-preserving process maintains alignment with ongoing execution, mitigates ambiguity and inconsistency, and reuses shared subtasks to reduce redundant execution. We also introduce CHIRP (Continual Household Instruction Reconciliation and Planning), a text-based benchmark of 120 episodes across eight household environments and six categories of everyday activities. On CHIRP, CIRRA achieves 74.2% decision agreement, exceeding the strongest replanning baseline by 30 percentage points; every correct fusion decision yields a correctly placed, conflict-free schedule. On a Unitree G1 humanoid, CIRRA interrupts ongoing skills at the correct moment in every trial and significantly outperforms all baselines on every metric.
Sources
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- LLM-Based Generalizable Hierarchical Task Planning and Execution for Heterogeneous Robot Teams with Event-Driven Replanning
- RT-1: Robotics Transformer for Real-World Control at Scale
- UniVLA: Learning to Act Anywhere with Task-centric Latent Actions
- Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks
- LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics
- Inner Monologue: Embodied Reasoning through Planning with Language Models
- OpenVLA: An Open-Source Vision-Language-Action Model
- HAMLET: Switch your Vision-Language-Action Model into a History-Aware Policy
- Interactive Task Planning with Language Models
- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
- Decompose, Plan in Parallel, and Merge: A Novel Paradigm for Large Language Models based Planning with Multiple Constraints
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model
- Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models
- SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
- ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
- RePLan: Robotic Replanning with Perception and Language Models
- Octo: An Open-Source Generalist Robot Policy
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies