Linear Multi-granular Body Modeling for Text-Driven Motion Generation

HiSTF Mamba is a linear-time framework for text-to-motion generation that solves issues with existing methods by combining local and global spatial modeling with bidirectional temporal encoding. It uses Dual-Spatial Mamba to capture both fine joint details and whole-body coordination, Bi-Temporal Mamba for long/short term dependencies, and a Dynamic Spatiotemporal Fusion Module (DSFM) to efficiently fuse features. Experiments show it significantly improves generation fidelity on HumanML3D while using fewer parameters than baseline models.

Open the full episode

More from AI Radio