CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR
cs.CL
Submitted: 2026-09-28
Updated: 2026-09-28
Code: https://github.com/cardamom-paper/Cardamom-data
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: We present Cardamom, a micro-dialectal Arabic speech dataset designed to support fine-grained evaluation and adaptation of automatic speech recognition (ASR) systems.
Terminology
Abstract
We present Cardamom, a micro-dialectal Arabic speech dataset designed to support fine-grained evaluation and adaptation of automatic speech recognition (ASR) systems. Community-curated by native speakers familiar with the represented varieties, Cardamom contains approximately 40 hours of transcribed YouTube speech spanning 21 micro-dialects across Egypt, Jordan, Lebanon, Mauritania, Palestine, and Saudi Arabia. Each segment is annotated with one or more operational micro-dialect labels, code-switching information, and utterance-level perceived gender, enabling analysis of sub-country variation that is obscured by conventional country-level labels. We describe the collection and annotation process, motivate the micro-dialect inventory linguistically, and benchmark four multilingual ASR systems in zero-shot and adapted settings. The strongest zero-shot system obtains 43.47% aggregate WER, with particularly high error rates on Mauritanian and Lebanese varieties; adaptation on Cardamom reduces its WER to 35.21%. Audio-based identification experiments further show that the annotations provide a learnable prediction target, with a dedicated classifier reaching 85.57% accuracy on 21-way micro-dialect identification. Cardamom provides a resource for studying localized dialectal variation and developing Arabic speech systems with broader regional coverage.
Sources
- Diacritic Recognition Performance in Arabic ASR
- Seamless: Multilingual Expressive and Streaming Speech Translation
- Habibi: Laying the Open-Source Foundation of Unified-Dialectal Arabic Speech Synthesis
- ADI-20: Arabic Dialect Identification dataset and models
- Overcoming Data Scarcity in Multi-Dialectal Arabic ASR via Whisper Fine-Tuning
- Arab Voices: Mapping Standard and Dialectal Arabic Speech Technology
- Zero-Shot Context-Aware ASR for Diverse Arabic Varieties
- N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognition
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering