Goal-Conditioned Supervised Learning for Multi-Objective Recommendation
cs.LG, cs.AI, cs.IR
Submitted: 2024-12-12
Updated: 2026-09-26
Comments: Accepted by NeurIPS 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Multi-objective learning endeavors to concurrently optimize multiple objectives using a single model, aiming to achieve high and balanced performance across diverse objectives.
Terminology
Abstract
Multi-objective learning endeavors to concurrently optimize multiple objectives using a single model, aiming to achieve high and balanced performance across diverse objectives. However, this often entails a complex optimization problem to balance the learning of potentially conflicting objectives, leading to solutions with higher memory requirements and computational complexity. This paper introduces a Multi-Objective Goal-Conditioned Supervised Learning (MOGCSL) framework for automatically learning to achieve multiple objectives from offline sequential data. MOGCSL extends the conventional GCSL method to multi-objective scenarios by redefining goals from one-dimensional scalars to multi-dimensional vectors. It benefits from naturally eliminating the need for complex architectures and optimization constraints. Moreover, MOGCSL inherently disentangles uninformative or noisy training instances that fail to achieve desirable long-term rewards across multiple objectives. We also introduce a novel goal-selection algorithm for MOGCSL to model and identify desired and achievable goals for inference. In this paper, we focus on its application to the next action prediction problem in commercial-grade recommender systems. In this context, any viable solution needs to be reasonably scalable and also be robust to large amounts of noisy data that is characteristic of this application space. We show that MOGCSL performs admirably on both counts by extensive experiments. Also, analysis and experiments are included to explain its strength in discounting the noisier portions of training data in recommender systems with multiple objectives.
Sources
- An Overview of Multi-Task Learning in Deep Neural Networks
- Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RL
- Goal-Conditioned Reinforcement Learning: Problems and Solutions
- OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning
- Reinformer: Max-Return Sequence Modeling for Offline RL
- Constrained Reinforcement Learning for Short Video Recommendation
- Conditional Generative Adversarial Nets
- Classifier-Free Diffusion Guidance
- Session-based Recommendations with Recurrent Neural Networks
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks