Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection
Zhiwei Yang, Haimei Qin, Xiaoyan Yu, Hao Peng, Lei Jiang, Li Sun, Zhiqin Yang
摘要
With the explosive growth of multimodal data streams on social media, the timely detection of emerging social events has become increasingly important. As a result, Multimodal Social Event Detection in open-world settings is receiving growing attention. However, most existing methods face two major limitations: (1) They overlook the dynamic nature of open-world social media data and fail to design dedicated incremental learning frameworks. (2) They ignore the impact of noise in streaming data, leading to performance degradation over long-term detection. To overcome these limitations, we propose SeInEvent (Structural Entropy Guided Incremental Learning for Open-World Multimodal Social Event Detection). Our innovations are as follows: First, considering data dynamics, we design a self-supervised alternating incremental contrastive learning mechanism. Through knowledge distillation, historical event clusters were reviewed and consolidated, and contrastive learning was combined to absorb knowledge of unknown events, ultimately achieving incremental learning without labels. Second, addressing the impact of noise, we propose a Pointwise Structural Entropy-based noise filter, which quantifies each sample’s informational contribution to the event clustering structure. It enables automatic removal of noisy data and supports robust long-term detection. Extensive experiments on two public datasets demonstrate that SeInEvent achieves superior performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 被引用 7,873 次
相关 Paper
- Generalized News Event Discovery via Dynamic Augmentation and Entropy OptimizationZehang Lin, Jiayuan Xie, Zhenguo Yang, Yi Yu 等ACM MM 2024
- SEBot: Structural Entropy Guided Multi-View Contrastive learning for Social Bot DetectionYingguang Yang, Qi Wu, Buyun He, Hao Peng 等KDD 2024 · 被引用 25 次
- Hierarchical and Incremental Structural Entropy Minimization for Unsupervised Social Event DetectionYuwei Cao, Hao Peng, Zhengtao Yu, Philip S. YuAAAI 2024 · 被引用 56 次
- Open-World Social Event ClassificationShengsheng Qian, Hong Chen, Dizhan Xue, Quan Fang 等WWW 2023 · 被引用 24 次
- Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNsYuwei Cao, Hao Peng, Jia Wu, Yingtong Dou 等WWW 2021 · 被引用 118 次
