Ouvia: A User-centered Framework for Measuring Usability of Speech Translation in Real-World Communication Scenarios
Ouvia is a new framework for measuring how usable speech translation is for real people, moving beyond simple quality scores. The study found that modern speech translation serves users only partially, with usability gaps across different groups. It concludes that quality-based evaluation (QA) is a much better predictor of real-world usability than standard metrics.