RefAtomNet++: Advancing Referring Atomic Video Action Recognition using Multi-Trajectory Semantic Retrieval
RefAtomNet++ recognizes fine-grained actions of specific people from video using natural language descriptions. It introduces a new framework that combines multi-hierarchical semantic retrieval with Mamba modeling to aggregate visual and linguistic information across different levels of detail, achieving state-of-the-art performance on complex scenarios.