Debiased Recommendation Beyond the Positive Propensity Assumption
Yanghao Xiao, Hao Wang, Xiang Li, Qian Zou, Cheng Bing, Wei Lin, Haoxuan Li, Zhouchen Lin
摘要
Post-click conversion rate (CVR) prediction is a central task in recommender systems, yet selection bias creates a severe distributional gap between the clicked training samples and the entire inference space. To address selection bias, propensity-based methods such as inverse propensity scoring (IPS) and doubly robust (DR) have been adopted, which aim to estimate the unbiased learning objective from biased training samples. However, these approaches assume strictly positive propensities, implying every user-item pair has a nonzero probability of interaction. In practice, such positivity assumption maybe violated, for example, in food-delivery platforms, some restaurants located more than 10 kilometers away will be blocked for recommendation. In this study, we theoretically show that when such zero-propensity samples, termed extrapolation samples exist, both IPS and DR estimators become biased. To overcome this limitation, we propose ExtraDebias method, which enables debiased recommendation in both non-extrapolation and extrapolation samples. Specifically, we first train a propensity model to identify extrapolation samples with extremely small propensity estimates, then estimate their pseudo-label intervals, and derive an upper bound of the learning objective for extrapolation samples. By minimizing the derived upper bound, debiased learning on extrapolation samples is ensured, while unbiased learning on non-extrapolation samples is achieved by standard IPS. Experiments on four real-world offline datasets and one online A/B test show that ExtraDebias effectively minimizes prediction errors on extrapolation samples and achieves optimal performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper31
- DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank SystemsRuoxi Wang, Rakesh Shivanna, Derek Zhiyuan Cheng, Sagar Jain 等WWW 2021 · 被引用 793 次
- AutoDebias: Learning to Debias for RecommendationJiawei Chen, Hande Dong, Yang Qiu, Xiangnan He 等SIGIR 2021 · 被引用 167 次
- Asymmetric Tri-training for Debiasing Missing-Not-At-Random Explicit FeedbackYuta SaitoSIGIR 2020 · 被引用 90 次
- ESCM2: Entire Space Counterfactual Multi-Task Model for Post-Click Conversion Rate EstimationHao Wang, Tai-Wei Chang, Tianqiao Liu, Jianmin Huang 等SIGIR 2022 · 被引用 86 次
- Personalized Adaptive Meta Learning for Cold-start User Preference PredictionRunsheng Yu, Yu Gong, Xu He, Yu Zhu 等AAAI 2021 · 被引用 72 次
相关 Paper
- A Generalized Doubly Robust Learning Framework for Debiasing Post-Click Conversion Rate PredictionQuanyu Dai, Haoxuan Li, Peng Wu, Zhenhua Dong 等KDD 2022 · 被引用 45 次
- Enhanced Doubly Robust Learning for Debiasing Post-Click Conversion Rate EstimationSiyuan Guo, Lixin Zou, Yiding Liu, Wenwen Ye 等SIGIR 2021 · 被引用 63 次
- Uncovering the Propensity Identification Problem in Debiased RecommendationsHonglei Zhang, Shuyi Wang, Haoxuan Li, Chunyuan Zheng 等ICDE 2024 · 被引用 12 次
- Adversarial-Enhanced Causal Multi-Task Framework for Debiasing Post-Click Conversion Rate EstimationXinyue Zhang, Cong Huang, Kun Zheng, Hongzu Su 等WWW 2024 · 被引用 8 次
- StableDR: Stabilized Doubly Robust Learning for Recommendation on Data Missing Not at RandomHaoxuan Li, Chunyuan Zheng, Peng WuICLR 2023 · 被引用 12 次
