Trajectory-based Diffusion from One-shot Human Video for Generalizable Manipulation
The authors introduced TDV, a trajectory-based diffusion framework that learns robot manipulation policies directly from single human videos. TDV extracts task-relevant object trajectories using 6D pose estimation, creating a visual domain-agnostic representation. This allows the robot to generalize its skills across different robots and visual settings with just one demonstration.