Invariant Feature Learning for Counterfactual Watch-time Prediction in Video Recommendation
Chenghou Jin, Yixin Ren, Hongxu Ma, Yewei Xia, Yi Guan, Hao Zhang, Jiandong Ding, Jihong Guan, Shuigeng Zhou
Abstract
Video recommendation systems heavily rely on user watch time feedback, making accurate watch time prediction a crucial task. However, this task inherently suffers from bias, as recommendation models tend to favor long-duration videos to maximize watch time. This issue, known as duration bias in the watch-time prediction context, can be explained from a causal perspective, where video duration acts as a confounder. Recent works address this bias using backdoor adjustment, isolating the direct effect of content on watch time from observational data. These methods typically discretize video duration into groups, estimate group-wise effects, and then aggregate them via a unified prediction model. However, this aggregation strategy is prone to model misspecification due to feature distribution shift across groups. In this paper, we reinterpret the problem through the lens of invariant learning and propose a novel framework: Duration-Invariant Feature Learning (DIFL). DIFL employs a kernel-based regularization that enforces representation invariance across duration groups, reducing sensitivity to group design and improving generalization. This enables more accurate modeling of the direct causal effect and making counterfactual inference. Extensive experiments on both public and real largescale production datasets demonstrate the effectiveness of the proposed approach, which achieves SOTA performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fca29496-40c2-4634-a2af-a2cdb6e3c902Cited by top-tier papers4
- One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query RefinementYixiao Zhou, Dongzhou Cheng, Zhiliang Wu, Yi Yang et al.ACL 2026 · 3 citations
- DiffoR: A Unified Continuous Generative Framework for Universal Ordinal RegressionHongxu Ma, Lin Wang, Chenghou Jin, Han Zhou et al.KDD 2026 · 1 citation
- FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized PriorsHongxu Ma, Han Zhou, Chenghou Jin, Jie Zhang et al.KDD 2026 · 1 citation
- GoR: A Unified and Extensible Generative Framework for Ordinal RegressionHongxu Ma, Han Zhou, Kai Tian, Xuefeng Zhang et al.ICLR 2026
Builds on15
- Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender SystemTianxin Wei, Fuli Feng, Jiawei Chen, Ziwei Wu et al.KDD 2021 · 246 citations
- Deconfounded Recommendation for Alleviating Bias AmplificationWenjie Wang, Fuli Feng, Xiangnan He, Xiang Wang et al.KDD 2021 · 155 citations
- Invariant Preference Learning for General Debiasing in RecommendationZimu Wang, Yue He, Jiashuo Liu, Wenchao Zou et al.KDD 2022 · 60 citations
- DVR: Micro-Video Recommendation Optimizing Watch-Time-Gain under Duration BiasYu Zheng, Chen Gao, Jingtao Ding, Lingling Yi et al.ACM MM 2022 · 28 citations
- Environment-Invariant Curriculum Relation Learning for Fine-Grained Scene Graph GenerationYukuan Min, Aming Wu, Cheng DengICCV 2023 · 16 citations
Related papers
- Counteracting Duration Bias in Video Recommendation via Counterfactual Watch TimeHaiyuan Zhao, Guohao Cai, Jieming Zhu, Zhenhua Dong et al.KDD 2024 · 9 citations
- Relative Advantage Debiasing for Watch-Time Prediction in Short-Video RecommendationEmily Liu, Kuan Han, Minfeng Zhan, Bocheng Zhao et al.AAAI 2026
- Contrastive Prototype Framework for Calibrating Video RecommendationFan Li, Jiazhen Huang, Shisong Tang, Bing Han et al.ACM MM 2025 · 3 citations
- Graph Representation Learning via Causal Diffusion for Out-of-Distribution RecommendationChu Zhao, Enneng Yang, Yuliang Liang, Pengxiang Lan et al.WWW 2025 · 21 citations
- Generative Regression Based Watch Time Prediction for Short-Video RecommendationHongxu Ma, Kai Tian, Tao Zhang, Xuefeng Zhang et al.WWW 2026 · 6 citations
