Awomo-SimDataEngine: Agentic Simulation-ReadyWorld Generation
cs.RO
Submitted: 2026-10-01
Updated: 2026-10-01
Project page: https://mimicgen.github.io/docs/introduction/overview.html
License: http://creativecommons.org/licenses/by/4.0/
The gist: Generating useful robot-training data requires more than visually plausiblescenes: objects must support interaction, placements must remain physicallyvalid, and tasks must admit repeatable execution.
Abstract
Generating useful robot-training data requires more than visually plausiblescenes: objects must support interaction, placements must remain physicallyvalid, and tasks must admit repeatable execution. We present Awomo-SimDataEngine, an agentic system that connects asset and scenegeneration to robot demonstration synthesis. Shared asset services providerigid and articulated objects, including structure-grounded part and jointgeneration with ISArt. Scene generation supports two complementary routes:Unravel reconstructs editable scenes from images, while SimForge buildssingle-room and multi-room environments from text. A graph-native harnesscoordinates construction, validation, andbounded repair, routing failures to the responsible module while retainingunaffected scene state. PolicyForge binds validated worlds to tasks and robotembodiments to produce replayable demonstrations. Evaluations cover assetgeometry, scene quality, and downstream policy learning. On MuJoCo-basedLIBERO-Plus, co-training with Isaac Sim demonstrations improves the overallsuccess rate of a World-Action Model (WAM) from 77.17% to 89.43%. Goal and spatialsuccess improve by 31.66 and 6.25 percentage points, respectively.These results support the utility of the generated data for cross-simulatorpolicy training, with more limited gains on long-horizon tasks.
Sources
- SAM 3: Segment Anything with Concepts
- I-Design: Personalized LLM Interior Designer
- Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
- LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models
- LayoutGPT: Compositional Visual Planning and Generation with Large Language Models
- AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes
- SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code
- MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
- Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation
- MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement
- BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
- DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling
- TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models
- InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior
- From Seeing to Simulating: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation
- P3-SAM: Native 3D Part Segmentation
- What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
- RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
- SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
- HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generation
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies