Query-Guided Spatial-Temporal-Frequency Interaction for Music Audio-Visual Question Answering
The QSTar method improves music audio-visual question answering by jointly considering query guidance and exploiting spatial, temporal, and frequency characteristics of audio signals. It uses a query-guided correlation module to refine features and a spatial-temporal-frequency interaction module to enhance cross-modal understanding. This approach leads to state-of-the-art performance on benchmarks.