Unsupervised Hyperbolic Representation Learning via Message Passing Auto-Encoders
Jiwoong Park, Junho Cho, Hyung Jin Chang, Jin Young Choi
Abstract
Most of the existing literature regarding hyperbolic embedding concentrate upon supervised learning, whereas the use of unsupervised hyperbolic embedding is less well explored. In this paper, we analyze how unsupervised tasks can benefit from learned representations in hyperbolic space. To explore how well the hierarchical structure of unlabeled data can be represented in hyperbolic spaces, we design a novel hyperbolic message passing auto-encoder whose overall auto-encoding is performed in hyperbolic space. The proposed model conducts auto-encoding the networks via fully utilizing hyperbolic geometry in message passing. Through extensive quantitative and qualitative analyses, we validate the properties and benefits of the unsupervised hyperbolic representations. Codes are available at https://github.com/junhocho/HGCAE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a837b77b-2901-4a13-bb4c-e6eec73268ceCited by top-tier papers9
- Hyperbolic Image SegmentationMina Ghadimi Atigh, Julian Schoep, Erman Acar, Nanne van Noord et al.CVPR 2022 · 70 citations
- The Euclidean Space is Evil: Hyperbolic Attribute Editing for Few-shot Image GenerationLingxiao Li, Yi Zhang, Shuhui WangICCV 2023 · 27 citations
- Hyp-OW: Exploiting Hierarchical Structure Learning with Hyperbolic Distance Enhances Open World Object DetectionThang Doan, Xin Li, Sima Behpour, Wenbin He et al.AAAI 2024 · 19 citations
- MHCN: A Hyperbolic Neural Network Model for Multi-view Hierarchical ClusteringFangfei Lin, Bing Bai, Yiwen Guo, Hao Chen et al.ICCV 2023 · 17 citations
- Hyperbolic Graph Diffusion ModelLingfeng Wen, Xuan Tang, Mingjie Ouyang, Xiangxiang Shen et al.AAAI 2024 · 16 citations
Builds on14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Contrastive Learning with Hard Negative SamplesJoshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie JegelkaICLR 2021 · 999 citations
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- On Mutual Information Maximization for Representation LearningMichael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly et al.ICLR 2020 · 559 citations
Related papers
- Learning the Predictability of the FutureDidac Suris, Ruoshi Liu, Carl VondrickCVPR 2021
- Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representationsJoy Hsu, Jeffrey Gu, Gong Her Wu, Wah Chiu et al.NeurIPS 2021 · 37 citations
- Unsupervised Hyperbolic Metric LearningJiexi Yan, Lei Luo, Cheng Deng, Heng HuangCVPR 2021
- Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic SpaceMenglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang et al.KDD 2021 · 101 citations
- Hyperbolic Representation Learning: Revisiting and AdvancingMenglin Yang, Min Zhou, Rex Ying, Yankai Chen et al.ICML 2023 · 41 citations
