Debiasing Recommendation by Learning Identifiable Latent Confounders
Qing Zhang, Xiaoying Zhang, Yang Liu, Hongning Wang, Min Gao, Jiheng Zhang, Ruocheng Guo
Abstract
Recommendation systems aim to predict users' feedback on items not exposed to them yet. Confounding bias arises due to the presence of unmeasured variables (e.g., the socio-economic status of a user) that can affect both a user's exposure and feedback. Existing methods either (1) make untenable assumptions about these unmeasured variables or (2) directly infer latent confounders from users' exposure. However, they cannot guarantee the identification of counterfactual feedback, which can lead to biased predictions. In this work, we propose a novel method, i.e., identifiable deconfounder (iDCF), which leverages a set of proxy variables (e.g., observed user features) to resolve the aforementioned nonidentification issue. The proposed iDCF is a general deconfounded recommendation framework that applies proximal causal inference to infer the unmeasured confounders and identify the counterfactual feedback with theoretical guarantees. Extensive experiments on various real-world and synthetic datasets verify the proposed method's effectiveness and robustness. CCS CONCEPTS • Information systems → World Wide Web.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 680bc054-8e1f-4ad1-b27a-32bf01b18b59Cited by top-tier papers5
- Debiasing Recommendation with Personal PopularityWentao Ning, Reynold Cheng, Xiao Yan, Ben Kao et al.WWW 2024 · 26 citations
- Treatment Effect Estimation for User Interest Exploration on Recommender SystemsJiaju Chen, Wenjie Wang, Chongming Gao, Peng Wu et al.SIGIR 2024 · 8 citations
- Causally Debiased Time-aware RecommendationLei Wang, Chen Ma, Xian Wu, Zhaopeng Qiu et al.WWW 2024 · 6 citations
- Navigate Beyond Shortcuts: Debiased Learning through the Lens of Neural CollapseYining Wang, Junjie Sun, Chenyue Wang, Mi Zhang et al.CVPR 2024 · 6 citations
- Conformal Counterfactual Inference under Hidden ConfoundingZonghao Chen, Ruocheng Guo, Jean-Francois Ton, Yang LiuKDD 2024 · 2 citations
Builds on6
- Causal Intervention for Leveraging Popularity Bias in RecommendationYang Zhang, Fuli Feng, Xiangnan He, Tianxin Wei et al.SIGIR 2021 · 431 citations
- Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender SystemTianxin Wei, Fuli Feng, Jiawei Chen, Ziwei Wu et al.KDD 2021 · 246 citations
- Invariant Preference Learning for General Debiasing in RecommendationZimu Wang, Yue He, Jiashuo Liu, Wenchao Zou et al.KDD 2022 · 60 citations
- A Model-Agnostic Causal Learning Framework for Recommendation using Search DataZihua Si, Xueran Han, Xiao Zhang, Jun Xu et al.WWW 2022 · 57 citations
- Addressing Unmeasured Confounder for Recommendation with Sensitivity AnalysisSihao Ding, Peng Wu, Fuli Feng, Yitong Wang et al.KDD 2022 · 43 citations
Related papers
- Deep Proxy Causal Learning and its Application to Confounded Bandit Policy EvaluationLiyuan Xu, Heishiro Kanagawa, Arthur GrettonNeurIPS 2021 · 52 citations
- Deep Learning Methods for Proximal Inference via Maximum Moment RestrictionBenjamin Kompa, David R. Bellamy, Thomas Kolokotrones, James M. Robins et al.NeurIPS 2022 · 22 citations
- Prior-Guided Accuracy-Bias Tradeoff Learning for CTR Prediction in Multimedia RecommendationDugang Liu, Yang Qiao, Xing Tang, Liang Chen et al.ACM MM 2023 · 5 citations
- Addressing Correlated Latent Exogenous Variables in Debiased Recommender SystemsShuqiang Zhang, Yuchao Zhang, Jinkun Chen, Haochen SuiKDD 2025 · 4 citations
- Adversarial Counterfactual Learning and Evaluation for Recommender SystemDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar et al.NeurIPS 2020 · 36 citations
