AphaVoice: Text-to-Speech Model for Aphasia Patient Simulation
cs.CL, cs.AI
Submitted: 2026-10-10
Updated: 2026-10-10
Comments: Accepted at IEEE Spoken Language Technology (SLT) 2026
Code: https://github.com/suno-ai/bark
License: http://creativecommons.org/licenses/by/4.0/
The gist: While language therapy is the primary treatment for post-stroke aphasia, limited clinical resources often restrict patient access to proper care.
Abstract
While language therapy is the primary treatment for post-stroke aphasia, limited clinical resources often restrict patient access to proper care. Addressing this gap requires reliable training simulations for medical professionals. However, current AI efforts focus almost exclusively on speech processing, leaving speech generation largely unexplored. This study introduces AphaVoice, a novel text-to-speech (TTS) framework explicitly engineered to synthesize highly realistic aphasic speech. Evaluated against state-of-the-art TTS systems, AphaVoice demonstrates a superior ability to capture the clinical feature of dysfluency, outperforming existing models in temporal metrics while consistently maintaining speaker identity. By leveraging latent space shifting, the model also supports multi-speaker generation without sacrificing phonetic realism. Ultimately, AphaVoice provides a scalable, high-fidelity tool for medical training and clinical simulation related to aphasia.
Sources
- XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
- VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
- EmoShift: Lightweight Activation Steering for Enhanced Emotion-Aware Speech Synthesis
- Accent Vector: Controllable Accent Manipulation for Multilingual TTS Without Accented Data
- EmotionTalk: An Interactive Chinese Multimodal Emotion Dataset With Rich Annotations
- SpeechBrain: A General-Purpose Speech Toolkit
- Vox-Profile: A Speech Foundation Model Benchmark for Characterizing Diverse Speaker and Speech Traits
- Text-to-Speech for Unseen Speakers via Low-Complexity Discrete Unit-Based Frame Selection
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering