VREgo: Consumer VR Headsets for Learning Robot Manipulation from Egocentric Demonstrations
cs.RO, cs.HC
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/facebookresearch/sam3
Sources
- EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devices
- EgoMimic: Scaling Imitation Learning via Egocentric Video
- EgoZero: Robot Learning from Smart Glasses
- Phantom: Training Robots Without Robots Using Only Human Videos
- HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
- Project Aria: A New Tool for Egocentric Multi-Modal AI Research
- EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video
- EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos
- EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World
- Introducing HOT3D: An Egocentric Dataset for 3D Hand and Object Tracking
- SAM 2: Segment Anything in Images and Videos
- CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videos
- SAM 3: Segment Anything with Concepts
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation