Understanding Mamba-3 Through Oscillatory Dynamics
The research interprets Mamba-3's data-dependent rotations as underdamped second-order dynamics. This framework shows that oscillatory behavior, specifically underdamped dynamics, outperforms other damping regimes in state tracking and benefits long-context prediction through learned phase regulation. The findings suggest that effective recurrent memory depends on both information retention and its transformation.