When Demonstrations Fail: Diagnosing the Limits of In-Context Learning in Large Audio-Language Models with Progressive Cue Removal
This research tested how Large Audio-Language Models (LALMs) learn from examples when given audio conditioning. The study found that while in-context demonstrations reliably improve how well models follow output formats, they fail to improve or often degrade the actual performance on the core speech tasks being performed.