Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection
Zhiwei Yang, Haimei Qin, Xiaoyan Yu, Hao Peng, Lei Jiang, Li Sun, Zhiqin Yang
Abstract
With the explosive growth of multimodal data streams on social media, the timely detection of emerging social events has become increasingly important. As a result, Multimodal Social Event Detection in open-world settings is receiving growing attention. However, most existing methods face two major limitations: (1) They overlook the dynamic nature of open-world social media data and fail to design dedicated incremental learning frameworks. (2) They ignore the impact of noise in streaming data, leading to performance degradation over long-term detection. To overcome these limitations, we propose SeInEvent (Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection). Our innovations are as follows: First, considering data dynamics, we design a self-supervised alternating incremental contrastive learning mechanism. Through knowledge distillation, historical event clusters were reviewed and consolidated, and contrastive learning was combined to absorb knowledge of unknown events, ultimately achieving incremental learning without labels. Second, addressing the impact of noise, we propose a Pointwise Structural Entropy-based noise filter, which quantifies each sample’s informational contribution to the event clustering structure. It enables automatic removal of noisy data and supports robust long-term detection. Extensive experiments on two public datasets demonstrate that SeInEvent achieves superior performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3b3aebd-e40d-4738-b748-3550d1c78b3dBuilds on13
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
Related papers
- Generalized News Event Discovery via Dynamic Augmentation and Entropy OptimizationZehang Lin, Jiayuan Xie, Zhenguo Yang, Yi Yu et al.ACM MM 2024
- SEBot: Structural Entropy Guided Multi-View Contrastive learning for Social Bot DetectionYingguang Yang, Qi Wu, Buyun He, Hao Peng et al.KDD 2024 · 25 citations
- Hierarchical and Incremental Structural Entropy Minimization for Unsupervised Social Event DetectionYuwei Cao, Hao Peng, Zhengtao Yu, Philip S. YuAAAI 2024 · 56 citations
- Open-World Social Event ClassificationShengsheng Qian, Hong Chen, Dizhan Xue, Quan Fang et al.WWW 2023 · 24 citations
- Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNsYuwei Cao, Hao Peng, Jia Wu, Yingtong Dou et al.WWW 2021 · 118 citations
