Pailitao-MMSearch: Building Native E-Commerce Multimodal Search Foundation

arXiv:2607.17499 · cs.AI · Submitted 2026-07-20 · Read on arXiv

cs.AI

Submitted: 2026-07-20

Updated: 2026-09-02

Comments: Technical Report: Pailitao-MMSearch

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Distillation — 17× in this paper · explained in 2 episodes
• Alignment — 13× in this paper · explained in 1 episode
• Quantization — 13× in this paper · explained in 12 episodes
• Foundation Model — 12× in this paper · explained in 3 episodes
• On-Policy Distillation — 12× in this paper · explained in 3 episodes
• Accuracy — 11× in this paper · explained in 1 episode
• Catastrophic Forgetting — 10× in this paper · explained in 5 episodes
• Embeddings — 10× in this paper · explained in 2 episodes
• Tokenization — 10× in this paper · explained in 2 episodes
• Benchmark — 8× in this paper · explained in 2 episodes
• Residual Quantization — 7× in this paper
• Ablation — 6× in this paper · explained in 1 episode
• Reinforcement Learning — 6× in this paper · explained in 4 episodes
• Adaptation — 5× in this paper · explained in 1 episode
• Domain Adaptation — 5× in this paper · explained in 5 episodes
• Fine-Tuning — 5× in this paper · explained in 5 episodes
• Foundation Models — 5× in this paper · explained in 7 episodes
• Ablation Studies — 3× in this paper · explained in 1 episode
• Click-Through Rate — 3× in this paper
• Generalization — 3× in this paper · explained in 13 episodes
• Gross Merchandise Volume — 3× in this paper
• Verifiable Rewards — 3× in this paper · explained in 2 episodes
• Agentic Search — 2× in this paper · explained in 1 episode
• Core — 2× in this paper · explained in 2 episodes
• Instruction Tuning — 2× in this paper · explained in 2 episodes
• Adaptive Training Strategies — 1× in this paper · explained in 1 episode
• Agentic Architecture — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Chain-of-Thought (CoT) — 1× in this paper · explained in 4 episodes
• Chain-of-Thought (CoT) Reasoning — 1× in this paper · explained in 2 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Contrastive Learning — 1× in this paper · explained in 5 episodes
• Decode — 1× in this paper · explained in 2 episodes
• Downstream Tasks — 1× in this paper · explained in 2 episodes
• Exposure Bias — 1× in this paper · explained in 2 episodes
• GRPO — 1× in this paper · explained in 6 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Multimodal Inputs — 1× in this paper · explained in 2 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Reward Hacking — 1× in this paper · explained in 8 episodes
• Supervised Fine-Tuning (SFT) — 1× in this paper · explained in 8 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Vision-Language Models (VLMs) — 1× in this paper · explained in 6 episodes

Sources

• ItemSage: Learning Product Embeddings for Shopping Recommendations at Pinterest
• OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Search
• InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
• Autoregressive Entity Retrieval
• SimCSE: Simple Contrastive Learning of Sentence Embeddings
• Dense Passage Retrieval for Open-Domain Question Answering
• An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
• GPT-4 Technical Report
• Code Llama: Open Foundation Models for Code
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• Qwen2.5 Technical Report
• Text Embeddings by Weakly-Supervised Contrastive Pre-training
• Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
• PUMGPT: A Large Vision-Language Model for Product Understanding
• Qwen3 Technical Report
• Visual Search at eBay
• FinGPT: Open-Source Financial Large Language Models
• eProduct: A Million-Scale Visual Search Benchmark to Address Product Recognition Challenges
• Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach
• OneRec-V2 Technical Report

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• Agents' Last Exam
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems