From Digital Human Interactions to Physics-Based Humanoid Skills: Physics-Grounded Post-Training of Interaction Generators
cs.CV
Submitted: 2026-10-07
Updated: 2026-10-07
Project page: https://1233chen.github.io/DIGHT
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent methods have made promising progress in generating interactions between two humanoids, largely relying on physics-based tracking policies to convert digital reference motions into executable
Abstract
Recent methods have made promising progress in generating interactions between two humanoids, largely relying on physics-based tracking policies to convert digital reference motions into executable trajectories. However, limited tracking capabilities restrict the range of reference motions that can be successfully executed, reducing data utilization. Moreover, even successful tracking does not guarantee physically plausible responses or faithful realization of the intended interactions. In this paper, we introduce DIGHT, a co-adaptive framework that couples a Digital human Interaction Generator with a Humanoid Tracking policy. Our DIGHT first executes multiple text-conditioned interaction candidates in simulation using a fixed tracker. It then constructs physics-grounded preferences from the resulting rollouts, covering both general executability and interaction fidelity. Rather than collapsing these signals into a single scalar reward for candidate ranking, we align the pretrained generator using physics-decoupled diffusion direct preference optimization (DPO), preserving criterion-specific supervision without differentiating through the simulator. To improve executability, preference pairs are derived from tracking error, friction, and floating. Additionally, to improve interaction fidelity, we propose to incorporate force feedback from simulator as a measure of contact fidelity and construct preferences over contact occurrence, location, duration, and force magnitude. The aligned generator then supplies reference motions for fine-tuning the tracker, improving compatibility between generation and physical execution. Extensive experiments demonstrate that our approach not only improves the physical plausibility of generated motions but also enables more reliable and faithful humanoid interactions in simulation.
Sources
- Retargeting Matters: General Motion Retargeting for Humanoid Motion Tracking
- Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrations
- InterMask: 3D Human Interaction Generation via Collaborative Masked Modeling
- TeamHOI: Learning a Unified Policy for Cooperative Human-Object Interactions with Any Team Size
- HINT: Hierarchical Interaction Modeling for Autoregressive Multi-Human Motion Generation
- Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning
- Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learning
- PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interaction
- PhysiInter: Integrating Physical Mapping for High-Fidelity Human Interaction Generation
- RL from Physical Feedback: Aligning Large Motion Models with Humanoid Control
- PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models