Holistic Parallel Supervision for Expressive Speech to Speech Translation
cs.CL
Submitted: 2026-11-04
Updated: 2026-11-04
Project page: https://hzted.github.io/truly-e2e-expressive-s2st-demo
Terminology
Sources
- Seamless: Multilingual Expressive and Streaming Speech Translation
- Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages
- Zero-shot Voice Conversion with Diffusion Transformers
- Moshi: a speech-text foundation model for real-time dialogue
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data