Lune

ACL Findings2023

HyHTM: Hyperbolic Geometry-based Hierarchical Topic Model

Simra Shahid, Tanay Anand, Nikitha Srikanth, Sumit Bhatia, Balaji Krishnamurthy, Nikaash Puri

Abstract

Hierarchical Topic Models (HTMs) are useful for discovering topic hierarchies in a collection of documents. However, traditional HTMs often produce hierarchies where lower-level topics are unrelated and not specific enough to their higher-level topics. Additionally, these methods can be computationally expensive. We present HyHTM -a Hyperbolic geometry based Hierarchical Topic Models -that addresses these limitations by incorporating hierarchical information from hyperbolic geometry to explicitly model hierarchies in topic models. Experimental results with four baselines show that HyHTM can better attend to parent-child relationships among topics. Hy-HTM produces coherent topic hierarchies that specialise in granularity from generic higherlevel topics to specific lower-level topics. Further, our model is significantly faster and leaves a much smaller memory footprint than our bestperforming baseline. We have made the source code for our algorithm publicly accessible. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • On the Affinity, Rationality, and Diversity of Hierarchical Topic Modeling cites CluHTM - Semantic Hierarchical Topic Modeling based on CluWords
  • On the Affinity, Rationality, and Diversity of Hierarchical Topic Modeling cites Knowledge-Aware Bayesian Deep Topic Model
  • Knowledge-Aware Bayesian Deep Topic Model cites Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. On the Affinity, Rationality, and Diversity of Hierarchical Topic ModelingXiaobao Wu, Fengjun Pan, Thong Nguyen, Yichao Feng et al.AAAI 2024 · 35 citations

Builds on6

  1. Hierarchical Topic Mining via Joint Spherical Tree and Text EmbeddingYu Meng, Yunyi Zhang, Jiaxin Huang, Yu Zhang et al.KDD 2020 · 56 citations
  2. Low-Dimensional Hyperbolic Knowledge Graph EmbeddingsInes Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala et al.ACL 2020 · 48 citations
  3. CluHTM - Semantic Hierarchical Topic Modeling based on CluWordsFelipe Viegas, Washington Cunha, Christian Gomes, Antônio Pereira De Souza Júnior et al.ACL 2020 · 34 citations
  4. CO-SNE: Dimensionality Reduction and Visualization for Hyperbolic DataYunhui Guo, Haoran Guo, Stella X. YuCVPR 2022 · 21 citations
  5. Knowledge-Aware Bayesian Deep Topic ModelDongsheng Wang, Yishi Xu, Miaoge Li, Zhibin Duan et al.NeurIPS 2022 · 19 citations

Related papers

  1. Hyperbolic Graph Topic Modeling Network with Continuously Updated Topic TreeDelvin Ce Zhang, Rex Ying, Hady W. LauwKDD 2023 · 6 citations
  2. HyperMiner: Topic Taxonomy Mining with Hyperbolic EmbeddingYishi Xu, Dongsheng Wang, Bo Chen, Ruiying Lu et al.NeurIPS 2022 · 38 citations
  3. Nonlinear Structural Equation Model Guided Gaussian Mixture Hierarchical Topic ModelingHegang Chen, Pengbo Mao, Yuyin Lu, Yanghui RaoACL 2023 · 13 citations
  4. HyperText: Endowing FastText with Hyperbolic GeometryYudong Zhu, Di Zhou, Jinghui Xiao, Xin Jiang et al.EMNLP Findings 2020 · 38 citations
  5. Learning Hierarchical Hyperbolic Mixture Model for Part-aware 3D GenerationQitong Yang, Mingtao Feng, Zijie Wu, Huixin Zhu et al.CVPR 2026
Dusk over the sea between two cliffs drawn in fine vertical lines