OmniHOI: Dexterous Hand-Object Interaction from Monocular Human Video
OmniHOI creates a pipeline to turn an RGB video of hand-object interaction into a physically consistent trajectory for dexterous hands. It enforces physical consistency across three stages: reconstruction, image-contact refinement, and physics-in-the-loop refinement. This method achieves superior success rates in transferring human interactions to robot motions.