Voice "Cloning" is Style Transfer
cs.SD, cs.AI, cs.HC, cs.LG
Submitted: 2026-05-15
Updated: 2026-10-06
Code: https://github.com/kzhou-cloud/voice-cloning-public
Terminology
Sources
- Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
- Neural Voice Cloning with a Few Samples
- EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control
- Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars
- NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
- Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale
- OpenVoice: Versatile Instant Voice Cloning
- NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
- Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
- InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Prompt
- Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data
Related papers
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
- AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
- SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
- WASIL: In-the-Wild Arabic Spoken Interactions with LLMs