ToolTurns: Benchmarking LLM Agents in Multi-Turn Dialogue
cs.CL
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/milad621/ToolTurns
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- Live API-Bench: 2500+ Live APIs for Testing Multi-Step Tool Calling
- ToolTalk: Evaluating Tool-Usage in a Conversational Setting
- VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications
- Gorilla: Large Language Model Connected with Massive APIs
- ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Models
- ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases
- MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data