VISTA: A Versatile Interactive User Simulation Toolkit for Agent Evaluation
cs.CL
Submitted: 2026-06-09
Updated: 2026-10-09
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- SimGym: Traffic-Grounded Browser Agents for Offline A/B Testing in E-Commerce
- Why Do Multi-Agent LLM Systems Fail?
- Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents
- LLM Agents for Education: Advances and Applications
- Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents
- SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?
- CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments
- AgentBench: Evaluating LLMs as Agents
- UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design
- Evaluation and Benchmarking of LLM Agents: A Survey
- Qwen3.5-Omni Technical Report
- ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents
- Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations
- SAGE: A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn AGent Evaluation
- OpenAI GPT-5 System Card
- LLM Agent Meets Agentic AI: Can LLM Agents Simulate Customers to Evaluate Agentic-AI-based Shopping Assistants?
- Human vs. Agent in Task-Oriented Conversations
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Survey on Evaluation of LLM-based Agents
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering