Learning to Generate Rigid Body Interactions with Video Diffusion Models
KineMask enables video diffusion models to generate realistic rigid body control and interactions by controlling initial object velocity. It uses a two-stage training strategy: first, training a ControlNet with velocity masks, then forcing the model to synthesize motion from initial conditions only. This allows for complex physical effects guided by both low-level velocity data and high-level text prompts.