What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities

arXiv:2610.19476 · cs.SD, cs.CL, cs.MM, eess.AS · Submitted 2026-10-14 · Read on arXiv

cs.SD, cs.CL, cs.MM, eess.AS

Submitted: 2026-10-14

Updated: 2026-10-14

Comments: Work in progress

License: http://creativecommons.org/licenses/by/4.0/

The gist: Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks.

Abstract

Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvements may reflect adaptation to specific question formats, such as multiple-choice questions, rather than genuine advances in audio understanding and reasoning capabilities. To investigate what LALMs actually learn from post-training, we conduct controlled experiments that disentangle improvements in audio understanding from adaptation to specific question formats. Across different models and post-training methods, we find that much of the reported improvement persists even without informative audio, but largely disappears when the question format changes. These findings suggest that post-training often teaches models to exploit task-specific textual cues and answer patterns rather than developing generalizable audio understanding and reasoning capabilities.

Related papers