DVI-DTM: Dual-View Representation Learning for Interpretable Short Text Dynamic Topic Modeling
Di Liu, Zheng Fang, Bin Wu
Abstract
Dynamic topic modeling aims to capture topic evolution from temporal text corpora. However, existing methods face two major challenges when applied to short texts: semantic ambiguity and interpretation ambiguity. Semantic ambiguity arises from the sparsity of short texts and the neglect of temporal semantic shifts. Interpretation ambiguity refers to the latent topics that lack human-understandable descriptions. In this work, we propose a novel D ual-V iew representation learning-based I nterpretable short text D ynamic T opic M odel ( DVI-DTM ). To address semantic ambiguity, the Dual-View Representation Learning module is presented to learn robust document-topic distributions by aligning temporal-aware term view and sentence view representations of short texts. To tackle interpretation ambiguity, we introduce a GEA Topic Refiner that leverages LLM agents to generate topic descriptions and refine document-topic distributions through collaborative semantic reasoning. Furthermore, a Dual-Factor Ranking module is designed to capture the topic evolution through semantic relevance and temporal uniqueness. Comprehensive experiments demonstrate that DVI-DTM outperforms the state-of-the-art baselines in topic alignment and dynamic topic quality metrics while producing highly interpretable topic descriptions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Is Automated Topic Model Evaluation Broken? The Incoherence of CoherenceAlexander Miserlis Hoyle, Pranav Goel, Andrew Hian-Cheong, Denis Peskov et al.NeurIPS 2021 · 220 citations
- Neural Dynamic Focused Topic ModelKostadin Cvejoski, Ramsés J. Sánchez, César OjedaAAAI 2023 · 9 citations
- LLM-Guided Semantic-Aware Clustering for Topic ModelingJianghan Liu, Ziyu Shang, Wenjun Ke, Peng Wang et al.ACL 2025 · 6 citations
- MIST: Mutual Information Maximization for Short Text ClusteringKrissanee Kamthawee, Can Udomcharoenchaikit, Sarana NutanongACL 2024 · 3 citations
- Evaluating Dynamic Topic ModelsCharu James, Mayank Nagda, Nooshin Haji Ghassemi, Marius Kloft et al.ACL 2024 · 1 citation
Related papers
- Neural Topic Modeling with Large Language Models in the LoopXiaohao Yang, He Zhao, Weijie Xu, Yuanyuan Qi et al.ACL 2025 · 13 citations
- An Online Semantic-enhanced Dirichlet Model for Short Text Stream ClusteringJay Kumar, Junming Shao, Salah Uddin, Wazir AliACL 2020 · 35 citations
- CEMTM: Contextual Embedding-based Multimodal Topic ModelingAmirhossein Abaskohi, Raymond Li, Chuyuan Li, Shafiq Joty et al.EMNLP 2025
- OTLDA: A Geometry-aware Optimal Transport Approach for Topic ModelingViet Huynh, He Zhao, Dinh PhungNeurIPS 2020 · 29 citations
- Global-Recent Semantic Reasoning on Dynamic Text-Attributed Graphs with Large Language ModelsYunan Wang, Jianxin Li, Ziwei ZhangICLR 2026 · 2 citations
