RecoAtlas: A Benchmark and RL Environment for LLM Recommendation Agents Optimizing Set-Level Utility
cs.IR, cs.AI, cs.LG
Submitted: 2026-05-11
Updated: 2026-11-03
Code: https://github.com/imadaouali/reco-atlas
Terminology
Sources
- AgentRecBench: Benchmarking LLM Agent-based Personalized Recommender Systems
- AgentBench: Evaluating LLMs as Agents
- GAIA: a benchmark for General AI Assistants
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- On the Tool Manipulation Capability of Open-source Large Language Models
- Gorilla: Large Language Model Connected with Massive APIs
- WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
- Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models
- ShoppingBench: A Real-World Intent-Grounded Shopping Benchmark for LLM-based Agents
- WebMall -- A Multi-Shop Benchmark for Evaluating Web Agents
- ShoppingComp: Are LLMs Really Ready for Your Shopping Cart?
- DeepShop: A Benchmark for Deep Research Shopping Agents
- RecMind: Large Language Model Powered Agent For Recommendation
- Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models
- A Survey on LLM-powered Agents for Recommender Systems
- Humans or LLMs as the Judge? A Study on Judgement Biases
- No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding
- RecoGym: A Reinforcement Learning Environment for the problem of Product Recommendation in Online Advertising
- RecSim: A Configurable Simulation Platform for Recommender Systems
- RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystems
Related papers
- UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction
- Revisiting Text Ranking in Deep Research
- GateSID: One Gate to Balance Semantic and Collaborative Signals across the Item Lifecycle
- SAM-D2Q: Aligning Multimodal Doc2Query with Search Demand and Conversion for E-commerce
- GINGER: Spicing Up Graph-Based Vector Search
- Subtraction Gets You More: Gap-Aware Retrieval for Multimodal Multi-Hop QA