Short Video Segment-level User Dynamic Interests Modeling in Personalized Recommendation
Zhiyu He, Zhixin Ling, Jiayu Li, Zhiqiang Guo, Weizhi Ma, Xinchen Luo, Min Zhang, Guorui Zhou
Abstract
The rapid growth of short videos has necessitated effective recommender systems to match users with content tailored to their evolving preferences. Current video recommendation models primarily treat each video as a whole, overlooking the dynamic nature of user preferences with specific video segments. In contrast, our research focuses on segment-level user interest modeling, which is crucial for understanding how users' preferences evolve during video browsing. To capture users' dynamic segment interests, we propose an innovative model that integrates a hybrid representation module, a multi-modal user-video encoder, and a segment interest decoder. Our model addresses the challenges of capturing dynamic interest patterns, missing segment-level labels, and fusing different modalities, achieving precise segment-level interest prediction.
We present two downstream tasks to evaluate the effectiveness of our segment interest modeling approach: video-skip prediction and short video recommendation. Our experiments on real-world short video datasets with diverse modalities show promising results on both tasks. It demonstrates that segment-level interest modeling brings a deep understanding of user engagement and enhances video recommendations. We also release a unique dataset that includes segment-level video data and diverse user behaviors, enabling further research in segment-level interest modeling. This work pioneers a novel perspective on understanding user segmentlevel preference, offering the potential for more personalized and engaging short video experiences.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation cites LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
- A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation cites Bootstrap Latent Representations for Multi-modal Recommendation
- Bootstrap Latent Representations for Multi-modal Recommendation cites A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation
- Bootstrap Latent Representations for Multi-modal Recommendation cites LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
Cited by top-tier papers1
Builds on17
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank SystemsRuoxi Wang, Rakesh Shivanna, Derek Zhiyuan Cheng, Sagar Jain et al.WWW 2021 · 793 citations
- Bootstrap Latent Representations for Multi-modal RecommendationXin Zhou, Hongyu Zhou, Yong Liu, Zhiwei Zeng et al.WWW 2023 · 326 citations
- A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal RecommendationXin Zhou, Zhiqi ShenACM MM 2023 · 234 citations
Related papers
- Learning Fine-grained User Interests for Micro-video RecommendationYu Shang, Chen Gao, Jiansheng Chen, Depeng Jin et al.SIGIR 2023 · 19 citations
- ProRec-Video: Guiding Hierarchical Interest Transitions for Proactive Short Video Recommendation with Dynamic Feedback AdaptationWeizhi Chen, Baoyun Peng, Bo Liu, Xingkong Ma et al.AAAI 2026
- What Aspect Do You Like: Multi-scale Time-aware User Interest Modeling for Micro-video RecommendationHao Jiang, Wenjie Wang, Yinwei Wei, Zan Gao et al.ACM MM 2020 · 65 citations
- Modeling Stage-wise Evolution of User Interests for News RecommendationZhiyong Cheng, Yike Jin, Zhijie Zhang, Huilin Chen et al.WWW 2026
- Disentangling Long and Short-Term Interests for RecommendationYu Zheng, Chen Gao, Jianxin Chang, Yanan Niu et al.WWW 2022 · 128 citations
