ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents
cs.AI
Submitted: 2026-05-15
Updated: 2026-11-13
Terminology
Sources
- Gym-Anything: Turn any Software into an Agent Environment
- SimGym: Traffic-Grounded Browser Agents for Offline A/B Testing in E-Commerce
- Safe and Scalable Web Agent Learning via Recreated Websites
- VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
- Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Data
- DeepShop: A Benchmark for Deep Research Shopping Agents
- WebMall -- A Multi-Shop Benchmark for Evaluating Web Agents
- OpenAI GPT-5 System Card
- The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs
- AgentA/B: Automated and Scalable Web A/BTesting with Interactive LLM Agents
- ProductResearch: Training E-Commerce Deep Research Agents via Multi-Agent Synthetic Trajectory Distillation
- ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants
- OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation
- Customer-R1: Personalized Simulation of Human Behaviors via RL-based LLM Agent in Online Shopping
- An Illusion of Progress? Assessing the Current State of Web Agents
- Shopping Companion: Benchmarking and Training LLM Agents for Long-Horizon Preference-Grounded E-Commerce Tasks
- WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent Benchmark
- LLaSA: Large Language and E-Commerce Shopping Assistant
- See, Think, Act: Online Shopper Behavior Simulation with VLM Agents
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents