Klein Hyperbolic Metric Learning
Yulin Zhang, Boxuan Hu, Huimin Li, Junlin Hu
Abstract
Hyperbolic metric learning is highly effective in embedding hierarchical data structures. However, past work has predominantly focused on the conformal Poincaré model, leaving other geometries like the Klein model largely under-explored. In addition, the curved geodesics of the Poincaré model present a fundamental geometric misalignment with the linear projections dominating the feature transformation steps in the modern neural network backbones. In this paper, we investigate the Klein model, a projective model of hyperbolic geometry whose straight-line geodesics offer a structurally aligned alternative in modern encoders, for hyperbolic metric learning. By formalizing a framework based on Einstein gyrovector operations, we derive a numerically stable metric learning approach that mitigates the inherent optimization challenges of the Klein model. Extensive experiments on multiple image datasets for fine-grained image classification task show that the Klein model not only serves as a viable alternative to the Poincaré model but also achieves highly competitive performance by leveraging its unique geometric properties, without increasing parameter complexity. Our empirical findings establish the Klein model as an efficient geometric prior for hyperbolic metric learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa et al.ICML 2021 · 8,974 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- Hyperbolic Vision Transformers: Combining Improvements in Metric LearningAleksandr Ermolov, Leyla Mirvakhabova, Valentin Khrulkov, Nicu Sebe et al.CVPR 2022 · 97 citations
Related papers
- Unsupervised Hyperbolic Metric LearningJiexi Yan, Lei Luo, Cheng Deng, Heng HuangCVPR 2021
- The Natural Geometry of Code: Hyperbolic Representation Learning for Program ReasoningWeilin ZhouICLR 2026
- Robust Hyperbolic Learning with Curvature-Aware OptimizationAhmad Bdeir, Johannes Burchert, Lars Schmidt-Thieme, Niels LandwehrNeurIPS 2025 · 4 citations
- Proper Velocity Neural NetworksZiheng Chen, Zihan Su, Bernhard Schölkopf, Nicu SebeICLR 2026
- Unsupervised Hyperbolic Representation Learning via Message Passing Auto-EncodersJiwoong Park, Junho Cho, Hyung Jin Chang, Jin Young ChoiCVPR 2021
