EMNLP Findings2021
Re-entry Prediction for Online Conversations via Self-Supervised Learning
Lingzhi Wang, Xingshan Zeng, Huang Hu, Kam-Fai Wong, Daxin Jiang
Abstract
In recent years, world business in online discussions and opinion sharing on social media is booming. Re-entry prediction task is thus proposed to help people keep track of the discussions which they wish to continue. Nevertheless, existing works only focus on exploiting chatting history and context information, and ignore the potential useful learning signals underlying conversation data, such as conversation thread patterns and repeated engagement of target users, which help better understand the behavior of target users in conversations. In this paper, we propose three interesting and well-founded auxiliary tasks, namely, Spread Pattern, Repeated Target user, and Turn Authorship, as the self-supervised signals for re-entry prediction. These auxiliary tasks are trained together with the main task in a multi-task manner. Experimental results on two datasets newly collected from Twitter and Reddit show that our method outperforms the previous state-of-the-arts with fewer parameters and faster convergence. Extensive experiments and analysis show the effectiveness of our proposed models and also point out some key ideas in designing self-supervised tasks. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers2
- Successful New-entry Prediction for Multi-Party Online Conversations via Latent Topics and Discourse ModelingLingzhi Wang, Jing Li, Xingshan Zeng, Kam-Fai WongWWW 2022 · 6 citations
- Outcome-Constrained Large Language Models for Countering Hate SpeechLingzi Hong, Pengcheng Luo, Eduardo Blanco, Xiaoying SongEMNLP 2024 · 5 citations
Builds on3
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based DialoguesRuijian Xu, Chongyang Tao, Daxin Jiang, Xueliang Zhao et al.AAAI 2021 · 76 citations
- Continuity of Topic, Interaction, and Query: Learning to Quote in Online ConversationsLingzhi Wang, Jing Li, Xingshan Zeng, Haisong Zhang et al.EMNLP 2020 · 13 citations
Related papers
- Dynamic Online Conversation RecommendationXingshan Zeng, Jing Li, Lu Wang, Zhiming Mao et al.ACL 2020 · 10 citations
- Deep Exogenous and Endogenous Influence Combination for Social Chatter Intensity PredictionSubhabrata Dutta, Sarah Masud, Soumen Chakrabarti, Tanmoy ChakrabortyKDD 2020 · 2 citations
- Dynamic Knowledge Routing Network for Target-Guided Open-Domain ConversationJinghui Qin, Zheng Ye, Jianheng Tang, Xiaodan LiangAAAI 2020 · 36 citations
- A Role-Selected Sharing Network for Joint Machine-Human Chatting Handoff and Service Satisfaction AnalysisJiawei Liu, Kaisong Song, Yangyang Kang, Guoxiu He et al.EMNLP 2021 · 7 citations
- Hate is the New Infodemic: A Topic-aware Modeling of Hate Speech Diffusion on TwitterSarah Masud, Subhabrata Dutta, Sakshi Makkar, Chhavi Jain et al.ICDE 2021 · 39 citations
