From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agents
The study created a framework to evaluate text-based tool-calling benchmarks using Text-to-Speech (TTS) to generate controlled audio inputs. This allows researchers to compare cascade and end-to-end omni-modal models by measuring performance loss when switching from text to speech, providing a verifiable diagnostic tool for architectural choice.