Action-Dynamics Modeling and Cross-Temporal Interaction for Online Action Understanding
The State-Specific Model (SSM) unifies online action detection and anticipation by modeling action dynamics using a State-Transition Graph. It compresses video memory into critical states, learns relations between these states via graph reasoning, and refines predictions through cross-temporal interaction, allowing for simultaneous detection and future cue derivation.