AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth

arXiv:2609.30483 · cs.SD, cs.CL, cs.LG, eess.AS · Submitted 2026-09-24 · Read on arXiv

cs.SD, cs.CL, cs.LG, eess.AS

Submitted: 2026-09-24

Updated: 2026-09-24

Comments: 5 pages, 3 figures, 2 tables. Submitted to ICASSP 2027. Siyuan Zhai and Chien-Liang Kuo contributed equally. Code and outputs: https://github.com/sheng-tse/acousticlaim

Code: https://github.com/sheng-tse/acousticlaim

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 9× in this paper · explained in 2 episodes
• Calibration — 2× in this paper · explained in 7 episodes
• Decode — 2× in this paper · explained in 2 episodes
• Abstention — 1× in this paper · explained in 1 episode
• Adaptation — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Linear probe — 1× in this paper · explained in 2 episodes

Sources

• Qwen2-Audio Technical Report
• LibriMix: An Open-Source Dataset for Generalizable Speech Separation
• Qwen2.5-Omni Technical Report
• Granite-speech: open-source speech-aware LLMs with strong English ASR capabilities

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs