ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation
cs.CV
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: Accepted at NeurIPS 2026 Evaluations & Datasets Track
Code: https://github.com/Breakthrough/PySceneDetect
Project page: https://elma-dataset.github.io/Abstract
License: http://creativecommons.org/licenses/by/4.0/
The gist: Text-guided long-term human motion generation is essential for applications such as continuously operating digital avatars.
Terminology
Abstract
Text-guided long-term human motion generation is essential for applications such as continuously operating digital avatars. Despite recent progress on short clips, existing models struggle with multi-segment instructions that involve anaphora, where constraints established in earlier segments must be preserved over time. In this paper, we introduce a novel task of long-term motion generation from such anaphoric compositions. To mitigate this, we present ELMA, an episodic long-term motion dataset with dense segment-level annotations that preserve cross-segment dependencies. Built via a fully automated collection and filtering pipeline, ELMA extracts high-quality, continuous 30-second clips from in-the-wild videos, capturing the episodic narratives necessary for long-range state modeling. Leveraging this dataset, we fine-tune state-of-the-art motion generation models to incorporate long-range context. Extensive experiments reveal fundamental shortcomings in current models when handling context-dependent instructions. We demonstrate that ELMA enables significant improvements in both global physical realism and semantic alignment, setting a robust new baseline for long-term motion synthesis.
Sources
- GPT-4 Technical Report
- Qwen2.5-VL Technical Report
- OpenT2M: No-frill Motion Generation with Open-source,Large-scale, High-quality Data
- FrankenMotion: Part-level Human Motion Generation and Composition
- SAM 2: Segment Anything in Images and Videos
- A Short Note on the Kinetics-700-2020 Human Action Dataset
- Dense Motion Captioning
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models