Ctrl-V: Higher Fidelity Video Generation with Bounding-Box Controlled Object Motion
Ctrl-V uses modified Stable Video Diffusion (SVD) models to control object motion in videos using bounding boxes. It first generates a 'skeleton' of moving boxes and then uses this control signal to generate high-fidelity video content. This method allows for precise, controllable object movement, which is vital for applications like autonomous driving.