ATHLETE: Learning Reactive Humanoid Tennis via Trajectory-Guided Motion Matching
cs.RO
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: projectpage:https://hazintihoa.github.io/athlete.github.io/#overview
Project page: https://hazintihoa.github.io/athlete.github.io/#overview
License: http://creativecommons.org/licenses/by/4.0/
The gist: Humanoid tennis requires reactive whole-body coordination under rapidly changing ball dynamics, yet collecting task-specific motion-capture demonstrations that cover diverse approach states, contact
Abstract
Humanoid tennis requires reactive whole-body coordination under rapidly changing ball dynamics, yet collecting task-specific motion-capture demonstrations that cover diverse approach states, contact locations, and timing conditions is costly. Inspired by how humans acquire new skills by combining reusable motor experience with task-specific demonstrations, we present ATHLETE, a framework for learning reactive humanoid tennis from generic locomotion data and ordinary tennis videos. ATHLETE combines LAFAN1 locomotion with video-derived striking motions and uses Trajectory-Guided Motion Matching (TGMM) to construct diverse task-conditioned whole-body references. These references are transformed into a reactive policy through physics-based teacher--student learning with online DAgger distillation, followed by PPO fine-tuning for the tennis task. The resulting policy responds directly to robot and ball observations without requiring reference-motion inputs at deployment. On a real humanoid robot, ATHLETE achieves forehand and backhand hit rates of 90.00% and 86.67%, respectively, and enables multi-shot rallies with human players. These results demonstrate that ATHLETE can learn dynamic humanoid tennis skills from reusable locomotion data and video demonstrations. Result videos and code can be found at https://anonymous.4open.science/w/ATHLETE2027/.
Sources
- Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Data
- Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching
- Kimodo: Scaling Controllable Human Motion Generation
- TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control
- OMG: Omni-Modal Motion Generation for Generalist Humanoid Control
- BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion
- Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain
- OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction
- HDMI: Learning Interactive Humanoid Whole-Body Control from Human Videos
- HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos
- TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes
- Retargeting Matters: General Motion Retargeting for Humanoid Motion Tracking
- Proximal Policy Optimization Algorithms
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies