GrainSpeech: Less Context, More Detail for Compact Speech Synthesis

arXiv:2609.18856 · eess.AS, cs.AI, cs.SD, eess.SP · Submitted 2026-09-16 · Read on arXiv

eess.AS, cs.AI, cs.SD, eess.SP

Submitted: 2026-09-16

Updated: 2026-09-16

Code: https://github.com/lab-emi/GrainSpeech

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Alignment — 2× in this paper · explained in 1 episode
• Over-smoothing — 2× in this paper · explained in 4 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Adaptation — 1× in this paper · explained in 1 episode
• Embeddings — 1× in this paper · explained in 2 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Flow Matching — 1× in this paper · explained in 8 episodes
• Quantization — 1× in this paper · explained in 12 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
• SpeedySpeech: Efficient Neural Speech Synthesis
• Towards Robust FastSpeech 2 by Modelling Residual Multimodality
• UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022

Related papers

• Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs
• X-VC: Zero-shot Streaming Voice Conversion in Codec Space
• Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakers
• VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation
• Conditional Flow Matching for Visually-Guided Acoustic Highlighting
• Anonymization, Not Elimination: Utility-Preserved Speech Anonymization