Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation

P3-WAM introduces a unified world action model for egocentric dexterous manipulation by integrating three modes: PERCEIVE (reconstructing 3D motion), PREDICT (anticipating future actions), and PLAN (jointly generating actions and visual consequences). Trained via a unified framework that varies observation visibility, the model achieves superior performance across all three capabilities compared to specialized single-mode methods.

Open the full episode

More from AI Radio