MARS: Multi-resolution Adaptive Routing for Sequential Recommendation
cs.AI
Submitted: 2026-10-05
Updated: 2026-10-05
Code: https://github.com/reczoo/Datasets
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long-history recommenders often compress each user's history into a compact, candidate-independent memory that is cached and reused to score large candidate pools.
Abstract
Long-history recommenders often compress each user's history into a compact, candidate-independent memory that is cached and reused to score large candidate pools. We show that real user histories exhibit multi-scale semantic structure, with short-lived intent, medium-term interests, and long-term preferences coexisting in one sequence, and that monolithic cached memories preserve these scales unevenly: linear probes recover recent and mid-range content far worse than long-range content. We call this failure mode temporal aliasing. We propose MARS, a multi-resolution user memory that writes the full history into recurrent state tracks anchored to different half-lives, and a sparse routing reader that materializes compact seed memories by selecting the relevant temporal resolutions for each seed, preserving fixed-size candidate scoring. MARS outperforms strong baselines on three public datasets, with gains that grow with history length. Component-matched ablations with paired tests show that temporal diversity and selective routing each contribute beyond what hard-window memories or added capacity provide. The advantage of MARS over its interface-matched baseline also widens after within-user behavioral shifts, at about 1.02 times that baseline's warm-cache serving latency for 1, 000 candidates per user.
Sources
- LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenders
- Massive Memorization with Hundreds of Trillions of Parameters for Sequential Transducer Generative Recommenders
- Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
- Weakly Supervised Video Representation Learning with Unaligned Text for Sequential Videos
- Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces
- Efficiently Modeling Long Sequences with Structured State Spaces
- Session-based Recommendations with Recurrent Neural Networks
- Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers
- Categorical Reparameterization with Gumbel-Softmax
- Self-Attentive Sequential Recommendation
- ms-Mamba: Multi-scale Mamba for Time-Series Forecasting
- A Clockwork RNN
- Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models
- Hi-SAM: A Hierarchical Structure-Aware Multi-modal Framework for Large-Scale Recommendation
- Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction
- A Comprehensive Review of Recommender Systems: Transitioning from Theory to Practice
- Rethinking Large-scale Pre-ranking System: Entire-chain Cross-domain Models
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
- Retentive Network: A Successor to Transformer for Large Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems