Zero-Shot Lombard Speech Synthesis with Controllable Style Embeddings

The system achieves zero-shot Lombard speech synthesis by learning a mapping between plain and Lombard speaker embeddings. It uses style embeddings from a large dataset, manipulated via Principal Component Analysis (PCA), to generate speech at desired loudness and clarity levels without needing specific Lombard training data. This allows for controllable, high-quality speech adaptation.

Open the full episode

More from AI Radio