OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation
eess.AS, cs.CL, cs.SD, eess.SP
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: submitted to ICASSP 2027
Code: https://github.com/fuann/open-apa
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Recent advances in automatic pronunciation assessment (APA) have driven a shift from scripted to free-form assessment.
Terminology
Abstract
Recent advances in automatic pronunciation assessment (APA) have driven a shift from scripted to free-form assessment. However, existing methods often rely on multi-stage pipelines with forced alignment and separate feature extractors, limiting their practicality across response settings. In light of this, we propose OpenPA, a novel APA framework that leverages Whisper's cross-attention mechanism to jointly predict word- and utterance-level pronunciation scores without forced alignment. Through mixed-transcript adaptation and adaptive substitution weighting, OpenPA accommodates heterogeneous transcripts across closed- and open-response settings within a single model. Trained solely on speechocean762, OpenPA achieves the strongest overall performance among evaluated systems under in-domain closed and simulated open-response conditions, while maintaining its performance zero-shot on MultiPA. An additional cross-task evaluation on oral-cancer speech suggests its potential applicability beyond non-native speech.
Sources
- PathBench: Speech Intelligibility Benchmark for Automatic Pathological Speech Assessment
- Qwen3-ASR Technical Report
Related papers
- Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs
- X-VC: Zero-shot Streaming Voice Conversion in Codec Space
- Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers
- VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation
- Conditional Flow Matching for Visually-Guided Acoustic Highlighting
- Anonymization, Not Elimination: Utility-Preserved Speech Anonymization