Understanding Cross-Domain Adaptation in Low-Resource Topic Modeling
Pritom Saha Akash, Kevin Chen-Chuan Chang
Abstract
Topic modeling plays a vital role in uncovering hidden semantic structures within text corpora, but existing models struggle in lowresource settings where limited target-domain data leads to unstable and incoherent topic inference. We address this challenge by formally introducing domain adaptation for lowresource topic modeling, where a high-resource source domain informs a low-resource target domain without overwhelming it with irrelevant content. We establish a finite-sample generalization bound showing that effective knowledge transfer depends on robust performance in both domains, minimizing latent-space discrepancy, and preventing overfitting to the data. Guided by these insights, we propose DALTA (Domain-Aligned Latent Topic Adaptation), a new framework that employs a shared encoder for domain-invariant features, specialized decoders for domain-specific nuances, and adversarial alignment to selectively transfer relevant information. Experiments on diverse lowresource datasets demonstrate that DALTA consistently outperforms state-of-the-art methods in terms of topic coherence, stability, and transferability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dcacae33-c877-4b19-88d2-cc62ed4aecdfBuilds on10
- Neural Topic Model via Optimal TransportHe Zhao, Dinh Phung, Viet Huynh, Trung Le et al.ICLR 2021 · 100 citations
- Effective Neural Topic Modeling with Embedding Clustering RegularizationXiaobao Wu, Xinshuai Dong, Thong Thanh Nguyen, Anh Tuan LuuICML 2023 · 87 citations
- Contrastive Learning for Neural Topic ModelThong Nguyen, Anh Tuan LuuNeurIPS 2021 · 82 citations
- FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic ModelXiaobao Wu, Thong Nguyen, Delvin Zhang, William Yang Wang et al.NeurIPS 2024 · 67 citations
- Short Text Topic Modeling with Topic Distribution Quantization and Negative Sampling DecoderXiaobao Wu, Chunping Li, Yan Zhu, Yishu MiaoEMNLP 2020 · 61 citations
Related papers
- Resource Efficient Domain AdaptationJunguang Jiang, Ximei Wang, Mingsheng Long, Jianmin WangACM MM 2020 · 26 citations
- Dynamic Domain Adaptation for Efficient InferenceShuang Li, Jinming Zhang, Wenxuan Ma, Chi Harold Liu et al.CVPR 2021
- TACIT: A Target-Agnostic Feature Disentanglement Framework for Cross-Domain Text ClassificationRui Song, Fausto Giunchiglia, Yingji Li, Mingjie Tian et al.AAAI 2024 · 10 citations
- Mining Useful General Data for Low-Resource Domain AdaptationPingjie Wang, Hongcheng Liu, Yusheng Liao, Ziqing Fan et al.ICML 2026 · 3 citations
- TFGDA: Exploring Topology and Feature Alignment in Semi-supervised Graph Domain Adaptation through Robust ClusteringJun Dan, Weiming Liu, Chunfeng Xie, Hua Yu et al.NeurIPS 2024 · 22 citations
