Tree! I am no Tree! I am a low dimensional Hyperbolic Embedding
Rishi Sonthalia, Anna C. Gilbert
Abstract
Given data, finding a faithful low-dimensional hyperbolic embedding of the data is a key method by which we can extract hierarchical information or learn representative geometric features of the data. In this paper, we explore a new method for learning hyperbolic representations that takes a metric-first approach. Rather than determining the low-dimensional hyperbolic embedding directly, we learn a tree structure on the data as an intermediate step. This tree structure can then be used directly to extract hierarchical information, embedded into a hyperbolic manifold using Sarkar's construction (Sarkar, 2012), or used as a tree approximation of the original metric. To this end, we present a novel fast algorithm TreeRep such that, given a -hyperbolic metric (for any ), the algorithm learns a tree structure that approximates the original metric. In the case when , we show analytically that TreeRep exactly recovers the original tree structure. We show empirically that TreeRep is not only many orders of magnitude faster than previous known algorithms, but also produces metrics with lower average distortion and higher mean average precision than most previous algorithms for learning hyperbolic embeddings, extracting hierarchical information, and approximating metrics via tree metrics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers20
- Hyperbolic Representation Learning: Revisiting and AdvancingMenglin Yang, Min Zhou, Rex Ying, Yankai Chen et al.ICML 2023 · 41 citations
- Hyperbolic Diffusion Embedding and Distance for Hierarchical Representation LearningYa-Wei Eileen Lin, Ronald R. Coifman, Gal Mishne, Ronen TalmonICML 2023 · 26 citations
- SINCERE: Sequential Interaction Networks representation learning on Co-Evolving RiEmannian manifoldsJunda Ye, Zhongbao Zhang, Li Sun, Yang Yan et al.WWW 2023 · 9 citations
- Complex Hyperbolic Knowledge Graph Embeddings with Fast Fourier TransformHuiru Xiao, Xin Liu, Yangqiu Song, Ginny Y. Wong et al.EMNLP 2022 · 9 citations
- Fitting Distances by Tree Metrics Minimizing the Total Error within a Constant FactorVincent Cohen-Addad, Debarati Das, Evangelos Kipouridis, Nikos Parotsidis et al.FOCS 2021 · 5 citations
Builds on2
Related papers
- Low-distortion and GPU-compatible Tree Embeddings in Hyperbolic SpaceMax van Spengler, Pascal MettesICML 2025
- Tree-Wasserstein Distance for High Dimensional Data with a Latent Feature HierarchyYa-Wei Eileen Lin, Ronald R. Coifman, Gal Mishne, Ronen TalmonICLR 2025
- On Efficient Low Distortion Ultrametric EmbeddingVincent Cohen-Addad, Karthik C. S., Guillaume LagardeICML 2020 · 13 citations
- Random Laplacian Features for Learning with Hyperbolic SpaceTao Yu, Christopher De SaICLR 2023 · 1 citation
- HyperMiner: Topic Taxonomy Mining with Hyperbolic EmbeddingYishi Xu, Dongsheng Wang, Bo Chen, Ruiying Lu et al.NeurIPS 2022 · 38 citations
