Movens-Zero: Scaling Humanoid Motion Foundation Models with Large-Scale Human Videos

arXiv:2610.41877 · cs.RO, cs.CV · Submitted 2026-10-30 · Read on arXiv

cs.RO, cs.CV

Submitted: 2026-10-30

Updated: 2026-10-30

Comments: Technical report. 86 pages, 31 figures, 15 tables. Project page: https://movens-zero.github.io

Code: https://github.com/IDEA-Research/Motion-X

Project page: https://movens-zero.github.io

License: http://creativecommons.org/licenses/by/4.0/

The gist: Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and by the difficulty of jointly learning from heterogeneous multimodal inputs while…

Terminology

Abstract

Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and by the difficulty of jointly learning from heterogeneous multimodal inputs while supporting real-time closed-loop control. We present Movens-5M, constructed from raw Internet videos through clip generation, quality filtering, semantic annotation, motion recovery, and physical refinement with humanoid retargeting and execution verification. It contains 15 million human-motion sequences and 5 million physically executable humanoid-motion sequences spanning over 10,000 hours, aligned with text, RGB video, speech, and music. Building on this data, we introduce Movens-Zero, a scalable understanding-generation-execution architecture that supports joint learning across modalities and real-time closed-loop execution. Task-mixed flow-matching training jointly optimizes a single action expert across seven generation tasks, enabling direct motion generation from text, speech, music, and video. Multimodal Real-Time Chunking connects overlapping chunks under continuously updated instructions and robot states for continuous closed-loop execution. We further introduce Movens-Intent, a four-track benchmark with 8,192 expert-verified condition-motion pairs across text, speech, music, and video. Experiments show consistent gains across all four modalities when scaling execution-verified data from 1% to 100% and action-expert capacity from 64M to 911M parameters, while demonstrating that data quality and cross-modal supervision improve generation and execution.

Sources

Related papers