Democratizing Robot-Use Agents: A Unified Harness with Open Models
cs.RO
Submitted: 2026-11-01
Updated: 2026-11-03
Code: https://github.com/openai/codex
Terminology
Sources
- Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
- RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies
- Show-Harness: Just a VLM Agent Can Play Robots
- OpenRUA: Robot-Use Agents Are Zero-Shot Visuomotor Policies
- CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation
- Gemini Robotics: Bringing AI into the Physical World
- Transferring the Intelligence of VLMs to Robotic Control
- Inner Monologue: Embodied Reasoning through Planning with Language Models
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- Agent as Policy for Robotic Manipulation
- OpenVLA: An Open-Source Vision-Language-Action Model
- Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning
- ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use
- Robo-Harness K1: Harnessing Robot-Use Agents via Perception Augmentation
- Code as Policies: Language Model Programs for Embodied Control
- ASPIRE: Agentic /Skills Discovery for Robotics
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation