tau-bench-LILT: Evaluating Conversational Agents on Realistic Multilingual Tool-Use Tasks
cs.CL
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/lilt/tau-bench-lilt
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Large Language Models Often Know When They Are Being Evaluated
- SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languages
- $\tau$-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains
- tau-Multilingual: Benchmarking Voice Agents Across Languages
- $\tau$-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data