EMNLP Findings2023
TADI: Topic-aware Attention and Powerful Dual-encoder Interaction for Recall in News Recommendation
Junxiang Jiang
Abstract
News recommendation is one of the widest commercialization in natural language processing research area, which aims to recommend news according to user interests. News recall plays an important role in news recommendation. It is to recall candidates from a very large news database. Recent researches of news recall mostly adopt dual-encoder architecture as it provides a much faster recall scheme, and they encode each word equally. However, these works remain two challenges: irrelevant word distraction and weak dualencoder interaction. Therefore, we propose a model Topic-aware Attention and powerful Dual-encoder Interaction for recall in news recommendation (TADI). To avoid irrelevant word distraction, TADI designs a Topic-aware Attention (TA) which weights words according to news topics. To enhance dual-encoder interaction, TADI provides a cheap yet powerful interaction module, namely Dual-encoder Interaction (DI). DI helps dual encoders interact powerfully based on two auxiliary targets. After performance comparisons between TADI and state-of-the-arts in a series of experiments, we verify the effectiveness of TADI.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on10
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTOmar Khattab, Matei ZahariaSIGIR 2020 · 1,246 citations
- MIND: A Large-scale Dataset for News RecommendationFangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu et al.ACL 2020 · 454 citations
- Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence ScoringSamuel Humeau, Kurt Shuster, Marie-Anne Lachaux, Jason WestonICLR 2020 · 316 citations
- MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained TransformersWenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong et al.ACL Findings 2021 · 260 citations
- MINER: Multi-Interest Matching Network for News RecommendationJian Li, Jieming Zhu, Qiwei Bi, Guohao Cai et al.ACL Findings 2022 · 74 citations
Related papers
- Personalized News Recommendation with Knowledge-aware Interactive MatchingTao Qi, Fangzhao Wu, Chuhan Wu, Yongfeng HuangSIGIR 2021 · 82 citations
- DIGAT: Modeling News Recommendation with Dual-Graph InteractionZhiming Mao, Jian Li, Hongru Wang, Xingshan Zeng et al.EMNLP Findings 2022 · 22 citations
- Two Birds with One Stone: Unified Model Learning for Both Recall and Ranking in News RecommendationChuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng HuangACL Findings 2022 · 13 citations
- Neural News Recommendation with Collaborative News Encoding and Structural User EncodingZhiming Mao, Xingshan Zeng, Kam-Fai WongEMNLP Findings 2021 · 28 citations
- PP-Rec: News Recommendation with Personalized User Interest and Time-aware News PopularityTao Qi, Fangzhao Wu, Chuhan Wu, Yongfeng HuangACL 2021
