WAXAL: A Large-Scale Multilingual African Language Speech Corpus

summary

The gist

The WAXAL dataset introduces a large-scale, openly accessible speech resource for 24 Sub-Saharan African languages to address the digital divide in speech technology development The collection…

In short

WAXAL is a large, open speech dataset for 24 Sub-Saharan African languages, providing resources for both Automated Speech Recognition (ASR) and Text-to-Speech (TTS). It aims to reduce the digital divide by offering high-quality data to help researchers build inclusive speech technologies for these languages.

Key concepts

WAXAL Dataset
A massive, openly accessible collection of speech data covering 24 African languages. It includes transcribed audio for ASR and high-quality recordings for TTS, intended to support the development of speech technology in under-resourced regions.
ASR Dataset
This component contains about 1,250 hours of natural, transcribed speech from 14 languages. It is used to train systems that can automatically convert spoken words into written text, helping to develop robust speech recognition for diverse African linguistic features.
TTS Dataset
This collection consists of over 235 hours of high-fidelity recordings from community members reading balanced scripts in 13 languages. It is specifically designed to create synthetic voices that sound natural and accurate for Text-to-Speech applications.

Terminology used across episodes

This episode discusses

The paper

WAXAL: A Large-Scale Multilingual African Language Speech Corpus · Read on arXiv

Abdoulaye Diack, Perry Nelson, Kwaku Agbesi, Angela Nakalembe, MohamedElfatih MohamedKhair, Vusumuzi Dube, Tavonga Siyavora, Subhashini Venugopalan, Jason Hickey, Uche Okonkwo, Abhishek Bapna, Isaac Wiafe, Raynard Dodzi Helegah, Elikem Doe Atsakpo, Charles Nutrokpor, Fiifi Baffoe Payin Winful, Kafui Kwashie Solaga, Jamal-Deen Abdulai, Akon Obu Ekpezu, Audace Niyonkuru, Samuel Rutunda, Boris Ishimwe, Michael Melese, Engineer Bainomugisha, Joyce Nakatumba-Nabende, Andrew Katumba, Claire Babirye, Jonathan Mukiibi, Vincent Kimani, Samuel Kibacia, James Maina, Fridah Emmah

Google Research · University of Ghana · Digital Umuganda, Addis Ababa University, Makerere University, Loud and Clear Comm. Ltd., Media Trust Ltd. · Gates Foundation · AIMS Senegal

Recent advances in speech technology predominantly favor high-resource languages, leaving speakers of Sub-Saharan African languages underserved. To bridge this divide, we introduce WAXAL, an open, large-scale speech dataset spanning 27 African languages representing over 100 million speakers. WAXAL comprises over 14,100 hours of speech collected in partnership with African academic and community organizations to build local research capacity: an Automatic Speech Recognition (ASR) corpus with 2,340 hours of transcribed, image-prompted natural speech across 19 languages (plus 11,760 untranscribed hours) and a studio-quality Text-to-Speech (TTS) corpus of 247 hours across 15 language configurations. We empirically benchmark three architecturally distinct ASR models -- Gemma 3n 2B, Whisper-Large-v3, and MMS-1B-all -- across the 19 ASR languages on strictly speaker-disjoint splits. Fine-tuning on WAXAL yields substantial gains, reducing macro-average WER by up to 58% for Whisper-Large-v3, 56% for Gemma 3n 2B, and 17% for MMS-1B-all (and Character Error Rate by up to 70%). WAXAL-fine-tuned models generalize zero-shot to three out-of-distribution benchmarks: FLEURS, Mozilla Common Voice, and Sunbird SALT. Finally, an LLM-as-judge semantic evaluation confirms that fine-tuning preserves speaker intent beyond surface-level transcription metrics. WAXAL is released at https://huggingface.co/datasets/google/WaxalNLP.

Transcript

Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.

Rosa: I'm Rosa.

Dev: And I'm Dev, here with Taro.

Rosa: We're looking at the paper: "WAXAL: A Large-Scale Multilingual African Language Speech Corpus".

Dev: Here's the gist of the paper. The WAXAL dataset introduces a large-scale, openly accessible speech resource for 24 Sub-Saharan African languages to address the digital divide in speech technology development The collection consists of an Automated Speech Recognition (ASR) dataset and a Text-to-Speech (TTS) dataset designed to catalyze research and enable the development of inclusive technologies.

Rosa: Dataset Scope and Components WAXAL is a largescale, openly accessible speech dataset for 24 languages representing over 100 million speakers The collection consists of two main components: an Automated Speech Recognition (ASR) dataset containing approximately 1,250 hours of transcribed, natural speech from a diverse range of speakers, and a Text-to-Speech (TTS) dataset with over 235 hours of high-quality, single-speaker recordings reading phonetically balanced scripts The ASR dataset spans 14 languages and the TTS dataset spans 13 languages Table 1 provides an overview of the statistics for both datasets.

Dev: Data Collection Methodology The WAXAL dataset was acquired through a multi-year effort (Jan 2021 - Mar 2024) funded by Google with involvement from several key partners in Africa, ensuring local expertise and community involvement The data collection involved distinct processes for ASR and TTS data 1.

Rosa: For the ASR dataset, participants were shown a diverse set of images covering at least 50 topics and asked to describe them in their native language to elicit more natural speech Each recording was captured in the speaker’s natural environment and has a minimum duration of 15 seconds A subset corresponding to 10% of the total collected audio was transcribed by paid, local linguistic experts using the local script where available or transliteration to English alphabet 2.

Title and authors: Rosa: We’re talking about the title "WAXAL: A Large-Scale Multilingual African Language Speech Corpus," and the authors include people from Google Research, University of Ghana, Digital Umuganda, Addis Ababa University, Makerere University, Loud and Clear Comm., Media Trust Ltd., Gates Foundation, AIMS Senegal.

Dev: That’s a lot of institutions backing this project. What matters is that they are pooling resources to create this resource for twenty-four languages representing over one hundred million speakers across the continent.

Rosa: The implication here is that they are trying to address the digital divide in speech technology development by creating an openly accessible resource under a CC-BY-four point zero license, which means researchers can actually use it widely <ref:2602.02734#pg1>.

Taro: I think making it openly available is important, but I always have to ask about the quality control on this scale of data; how much manual effort went into getting these one thousand two hundred fifty hours transcribed for ASR?

Dev: Well, the paper mentions that a subset corresponding to ten percent of the total collected audio was transcribed by paid, local linguistic experts using the local script where available or transliteration to English alphabet <ref:2602.02734#pg1>.

Rosa: That means they’re not claiming perfect transcription across all hours, which is important for setting expectations about what the models can actually learn from this specific corpus.

The paper's summary: Dev: Moving on to the summary, WAXAL is described as a large-scale speech dataset consisting of an ASR dataset and a TTS dataset designed to catalyze research and enable the development of inclusive technologies.

Rosa: So, essentially it’s about providing both the transcribed audio for speech recognition and high-quality recordings for text synthesis across twenty-four languages.

Taro: When you look at the scale, they have ASR with approximately one thousand two hundred fifty hours and TTS with over one hundred eighty hours of studio-quality recordings across those ten target languages.

Dev: The key part is the metadata they provide along with the data; this includes valuable speaker demographics, which helps researchers understand the diversity present in each dataset.

Rosa: They also mention that they've done a lot of work on ensuring linguistic quality by having local experts transcribe the audio using local scripts when possible.

Taro: But I’m still focused on what this means for the world; it means giving people in these languages a chance to have voice-enabled applications like virtual assistants or automated transcription services built for their specific tongues.

The paper's improvements: Rosa: The authors highlight several key aspects of the WAXAL collection as improvements, specifically mentioning the high-quality TTS corpus and the rich metadata they include.

Dev: They also point out that they’ve created a phonetically balanced script of approximately one hundred eight thousand five hundred words for each of those ten target languages to make sure the TTS data is consistent.

Taro: What I find compelling about the improvements is how they are explicitly designed to be used for building high-fidelity TTS systems, which is a specific need in these language communities.

Rosa: And they emphasize that the entire WAXAL collection is made publicly available under a CC-BY-four point zero license, which encourages widespread use in both academic and commercial research <ref:2602.02734#pg1>.

Dev: That licensing choice is significant because it lowers the barrier for entry for anyone looking to develop speech technology solutions for these languages.

Conclusion: Rosa: To wrap things up, WAXAL provides a foundational resource by offering around one thousand five hundred hours of annotated ASR and TTS data across twenty-four languages, which is a significant step toward addressing the scarcity that has hindered speech technology development for Sub-Saharan African languages.

Dev: It’s a vital resource for building and evaluating models because it gives researchers something concrete to work with when they are trying to develop robust systems for these specific linguistic characteristics.

Taro: From my side, I think what matters is that this collection allows people to start experimenting with creating voice-enabled applications in their native languages right now, rather than waiting for much larger datasets.

Rosa: So WAXAL is being released publicly under the CC-BY-four point zero license at Hugging Face so that the research community can access it and use it freely for building and evaluating models <ref:2602.02734#pg1>.

Dev: It’s a big contribution to making sure these languages get the speech technology they need to be inclusive, but we still have to be mindful of those limitations like dialectal representation.

More episodes

← Home