Bidirectional Counterfactual Distillation for Review-Based Recommendation
Sheng Sang, Shujie Li, Shuaiyang Li, Kang Liu, Teng Li, Wei Jia, Dan Guo, Feng Xue
Abstract
Review-based recommendation methods typically integrate multiple behaviors, including interactions, reviews, and ratings, to model user preferences. To effectively extract preference signals from diverse behaviors, some studies train multiple student models to capture distinct behavioral patterns, and leverage online distillation to facilitate collaborative learning among them. However, we argue that these techniques suffer from bias contamination from rating distributions and feature homogenization during cross-behavior knowledge transfer: (1) Rating distribution bias, arising from non-uniform historical ratings, propagates across behaviors through distillation, contaminating the true preference representations of other behaviors. (2) Static distillation strategies often lead to homogenized behavioral features, hindering the learning of behavior-specific preferences. To address these issues, we propose a novel Bidirectional Counterfactual Distillation (Bi-CoD) framework for review-based recommendation. In Bi-CoD, we first design an adversarial counterfactual distillation module to suppress the impact of non-uniform rating distributions on distillation, thereby preventing it from contaminating the user's true preference representations across behaviors. Subsequently, we introduce a stage-aware bidirectional distillation strategy to enhance the distinctiveness of behavioral features, facilitating the effective learning of behavior-specific preferences. Extensive experiments on five real-world datasets validate the effectiveness and superiority of the proposed framework.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on17
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Disentangling User Interest and Conformity for Recommendation with Causal EmbeddingYu Zheng, Chen Gao, Xiang Li, Xiangnan He et al.WWW 2021 · 392 citations
- Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender SystemTianxin Wei, Fuli Feng, Jiawei Chen, Ziwei Wu et al.KDD 2021 · 246 citations
- A Review-aware Graph Contrastive Learning Framework for RecommendationJie Shuai, Kun Zhang, Le Wu, Peijie Sun et al.SIGIR 2022 · 170 citations
- Peer Collaborative Learning for Online Knowledge DistillationGuile Wu, Shaogang GongAAAI 2021 · 150 citations
Related papers
- Bidirectional Distillation for Top-K Recommender SystemWonbin Kweon, SeongKu Kang, Hwanjo YuWWW 2021 · 58 citations
- Modality-Balanced Learning for Multimedia RecommendationJinghao Zhang, Guofan Liu, Qiang Liu, Shu Wu et al.ACM MM 2024 · 21 citations
- Interpolative Distillation for Unifying Biased and Debiased RecommendationSihao Ding, Fuli Feng, Xiangnan He, Jinqiu Jin et al.SIGIR 2022 · 27 citations
- A General Knowledge Distillation Framework for Counterfactual Recommendation via Uniform DataDugang Liu, Pengxiang Cheng, Zhenhua Dong, Xiuqiang He et al.SIGIR 2020 · 188 citations
- Incremental Multi-Behavior RecommendationJiahao Gong, Weike PanSIGIR 2026
