X-Talk: On the Underestimated Potential of Modular Speech-to-Speech Dialogue System
cs.SD
Submitted: 2025-12-21
Updated: 2026-11-08
Code: https://github.com/xcc-zach/xtalk
Terminology
Sources
- FastEnhancer: Speed-Optimized Streaming Neural Speech Enhancement
- FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
- ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
- Do Audio LLMs Really LISTEN, or Just Transcribe? Measuring Lexical vs. Acoustic Emotion Cues Reliance
- FireRedChat: A Pluggable, Full-Duplex Voice Interaction System with Cascaded and Semi-Cascaded Implementations
- STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models
- Moshi: a speech-text foundation model for real-time dialogue
- IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
- Kimi-Audio Technical Report
- CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models
- GPT-4o System Card
- Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perception
- Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming
- Mini-Omni-Reasoner: Token-Level Thinking-in-Speaking in Large Speech Models
- Qwen2.5-Omni Technical Report
- Qwen3-Omni Technical Report
- Qwen2.5 Technical Report
- Qwen3 Technical Report
- Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guard
- Zipformer: A faster and better encoder for automatic speech recognition
Related papers
- Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
- MuLaCover: Flexible Cover Song Generation via Symbolic Tonal Control
- Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems