MS-Bench: A Condition-Stratified Multi-Speaker ASR Benchmark
MSBench introduces a condition-stratified benchmark for fine-grained evaluation of Multi-Speaker Automatic Speech Recognition (MSASR) systems. It characterizes recordings across five dimensions: speaker number, overlap ratio, speaker similarity, turn interval, and acoustic quality. The study reveals that aggregate metrics hide failure modes, demonstrating the need for condition-specific testing to improve system robustness.