A Data-Centric Multi-Objective Learning Framework for Responsible Recommendation Systems
Xu Huang, Jianxun Lian, Hao Wang, Hao Liao, Defu Lian, Xing Xie
Abstract
Recommendation systems guide users in locating their desired information within extensive content repositories. Usually, a recommendation model is optimized to enhance accuracy metrics from a user utility standpoint, such as click-through rate or matching relevance. However, a responsible industrial recommendation model must address not only user utility (responsibility to users) but also other objectives, including increasing platform revenue (responsibility to platforms), ensuring fairness (responsibility to content creators), and maintaining unbiasedness (responsibility to long-term healthy development). Multi-objective learning is a promising approach for achieving responsible recommendation models. Nevertheless, current methods encounter two challenges: difficulty in scaling to heterogeneous objectives within a unified framework, and inadequate controllability over objective priority during optimization, leading to uncontrollable solutions. In this paper, we present a data-centric optimization framework, MoRec, which unifies the learning of diverse objectives. MoRec is a tri-level framework: the outer level manages the balance between different objectives, utilizing a proportional-integral-derivative (PID)-based controller to ensure a preset regularization on the primary objective. The middle level transforms objective-aware optimization into data sampling weights using sign gradients. The inner level employs a standard optimizer to update model parameters with the sampled data. Consequently, MoRec can flexibly support various objectives while maintaining the original model intact. Comprehensive experiments on two public datasets and one industrial dataset showcase the effectiveness, controllability, flexibility, and Pareto efficiency of MoRec, making it highly suitable for real-world implementation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e1963db5-0e8a-4f7e-813d-807531d85706Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Multi-Task Learning with User Preferences: Gradient Descent with Controlled Ascent in Pareto OptimizationDebabrata Mahapatra, Vaibhav RajanICML 2020 · 182 citations
- FairBatch: Batch Selection for Model FairnessYuji Roh, Kangwook Lee, Steven Euijong Whang, Changho SuhICLR 2021 · 156 citations
- ControlVAE: Controllable Variational AutoencoderHuajie Shao, Shuochao Yao, Dachun Sun, Aston Zhang et al.ICML 2020 · 126 citations
- Efficient Continuous Pareto Exploration in Multi-Task LearningPingchuan Ma, Tao Du, Wojciech MatusikICML 2020 · 108 citations
- Do Current Multi-Task Optimization Methods in Deep Learning Even Help?Derrick Xin, Behrooz Ghorbani, Justin Gilmer, Ankush Garg et al.NeurIPS 2022 · 91 citations
Related papers
- Personalized Approximate Pareto-Efficient RecommendationRuobing Xie, Yanlei Liu, Shaoliang Zhang, Rui Wang et al.WWW 2021 · 46 citations
- Interpolating Item and User Fairness in Multi-Sided RecommendationsQinyi Chen, Jason Cheuk Nam Liang, Negin Golrezaei, Djallel BouneffoufNeurIPS 2024 · 8 citations
- Pareto Optimality for Fairness-constrained Collaborative FilteringQianxiu Hao, Qianqian Xu, Zhiyong Yang, Qingming HuangACM MM 2021 · 13 citations
- User-item fairness tradeoffs in recommendationsSophie Greenwood, Sudalakshmee Chiniah, Nikhil GargNeurIPS 2024 · 15 citations
- Agnostic Learning with Multiple ObjectivesCorinna Cortes, Mehryar Mohri, Javier Gonzalvo, Dmitry StorcheusNeurIPS 2020 · 25 citations
