CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with Timelines
cs.CL
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/Da1yuqin/CARTBench
Terminology
Sources
- EComAgentBench: Benchmarking Shopping Agents on Long-Horizon Tasks with Distributed Hidden Intent
- Shopping Reasoning Bench: An Expert-Authored Benchmark for Multi-Turn Conversational Shopping Assistants
- MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agents
- PACEShop: Evaluating Personalized, Actionable, Compositional, and Evidence-grounded Shopping Assistants
- DeepShop: A Benchmark for Deep Research Shopping Agents
- Deep Research as Rubric for Reinforcement Learning
- MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs
- ShoppingComp: Are LLMs Really Ready for Your Shopping Cart?
- RealWorldShop: Benchmarking and Improving Conversational Shopping Agents in Real-World E-commerce
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data