Monitoring geometrical properties of word embeddings for detecting the emergence of new topics
Clément Christophe, Julien Velcin, Jairo Cugliari, Manel Boumghar, Philippe Suignard
Abstract
Slow emerging topic detection is a task between event detection, where we aggregate behaviors of different words on short period of time, and language evolution, where we monitor their long term evolution. In this work, we tackle the problem of early detection of slowly emerging new topics. To this end, we gather evidence of weak signals at the word level. We propose to monitor the behavior of words representation in an embedding space and use one of its geometrical properties to characterize the emergence of topics. As evaluation is typically hard for this kind of task, we present a framework for quantitative evaluation. We show positive results that outperform state-ofthe-art methods on two public datasets of press and scientific articles.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- Sequential Modelling of the Evolution of Word Representations for Semantic Change DetectionAdam Tsakalidis, Maria LiakataEMNLP 2020 · 14 citations
- Emerging Topic Detection on the Meta-data of Images from Fashion Social MediaKunihiro Miyazaki, Takayuki Uchiba, Scarlett Young, Yuichi Sasaki et al.ACM MM 2020 · 1 citation
- Representing Mixtures of Word Embeddings with Mixtures of Topic EmbeddingsDongsheng Wang, Dandan Guo, He Zhao, Huangjie Zheng et al.ICLR 2022 · 56 citations
- Back to the Future - Temporal Adaptation of Text RepresentationsJohannes Bjerva, Wouter M. Kouw, Isabelle AugensteinAAAI 2020 · 10 citations
- Effective Neural Topic Modeling with Embedding Clustering RegularizationXiaobao Wu, Xinshuai Dong, Thong Thanh Nguyen, Anh Tuan LuuICML 2023 · 87 citations
