Do Multi-Turn Conversational Capabilities Carry Over from Text to Speech? A Parallel Multilingual Benchmark
cs.CL
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/QwenLM/Omnilingua-Bench
Terminology
Sources
- M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models
- Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
- Qwen2.5-Omni Technical Report
- Qwen3-Omni Technical Report
- Do What I Say: A Spoken Prompt Dataset for Instruction-Following
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data