RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation
cs.RO, cs.AI
Submitted: 2026-09-08
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: Bimanual manipulation policies require large and diverse training datasets, yet collecting demonstrations on physical robots is expensive and difficult to scale.
Terminology
Abstract
Bimanual manipulation policies require large and diverse training datasets, yet collecting demonstrations on physical robots is expensive and difficult to scale. Simulation can generate data efficiently, but existing pipelines typically operate within closed asset libraries and predefined scenes: adding a newly observed object or environment still requires substantial effort to reconstruct geometry, specify physical and semantic properties, annotate interactions, and integrate the result into executable tasks. We present RoboCousin, an extensible simulation-based data-generation platform that turns user-provided observations into reusable assets, scenes, and expert trajectories for bimanual manipulation. Built on RoboTwin~2.0, RoboCousin converts object images into simulation-ready assets with visual and collision geometry, semantic and physical metadata, and automatically generated grasp-contact candidates. It further constructs digital cousins that vary compatible objects, backgrounds, layouts, and language instructions while preserving task-relevant affordances and spatial relations. The same asset system supports tabletop and room-level scene construction, with collision-aware base control for interaction beyond a fixed workspace. We release RoboCousin-OBD, containing more than 3,000 annotated object instances and 50 background environments, and use RoboCousin to generate over one million expert trajectories across 50 tasks. Simulation and real-robot experiments show that the automatically generated interaction annotations are comparable to curated annotations, generated assets provide effective sim-to-real supervision, and tabletop cousins can improve transfer beyond training on a single reconstructed scene. RoboCousin therefore provides a practical path for expanding both the scale and coverage of synthetic bimanual manipulation data.
Sources
- SAM 3: Segment Anything with Concepts
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- Automated Creation of Digital Cousins for Robust Policy Learning
- GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data
- ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills
- From Seeing to Simulating: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation
- MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations
- RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
- THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation
- SAM 3D: 3Dfy Anything in Images
- ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AI
- Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulation
- EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligence
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies