WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models

WorldCraft expands video world models from simple camera navigation to allowing users to control specific objects within a scene while the camera moves. It achieves this by introducing three core components: Normalized World Trajectory, Spatial-Pathway LoRA, and Trajectory-Anchored State Persistence. This enables precise object manipulation and keeps the model's original camera control intact.

Open the full episode

More from AI Radio