InteractionBench: Measuring Timing, Task Accuracy, Whisper and Volume, and Grounding in Real-Time Voice Systems
cs.SD, cs.CL, eess.AS
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/avera-labs/InteractionBench
Project page: https://avera-labs.github.io/InteractionBench
Terminology
Sources
- Game-Time: Evaluating Temporal Dynamics in Spoken Language Models
- Moshi: a speech-text foundation model for real-time dialogue
- MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols
- M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models
- FLEXI: Benchmarking Full-duplex Human-LLM Speech Interaction
- CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems
- Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction
- TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue
- Does Your Voice Assistant Remember? Analyzing Conversational Context Recall and Utilization in Voice Interaction Models
- OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Models
- WavBench: Benchmarking Reasoning, Colloquialism, and Paralinguistics for End-to-End Spoken Dialogue Models
- Decoupling Conversational Dynamics in Full-Duplex Spoken Models through Reinforcement Learning
- Full-Duplex-Bench v1.5: Evaluating Overlap Handling for Full-Duplex Speech Models
- Full-Duplex-Bench-v3: Benchmarking Tool Use for Full-Duplex Voice Agents Under Real-World Disfluency
- SpeechParaling-Bench: A Comprehensive Benchmark for Paralinguistic-Aware Speech Generation
- Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents
- HalluDial: A Large-Scale Benchmark for Automatic Dialogue-Level Hallucination Evaluation
- C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations
- DuplexSpeechBench-IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agents
- EchoChain: A Full-Duplex Benchmark for State-Update Reasoning Under Interruptions
Related papers
- Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
- MuLaCover: Flexible Cover Song Generation via Symbolic Tonal Control
- Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems