Hyperbolic Busemann Neural Networks
Ziheng Chen, Bernhard Schölkopf, Nicu Sebe
摘要
Hyperbolic spaces provide a natural geometry for representing hierarchical and tree-structured data due to their exponential volume growth. To leverage these benefits, neural networks require intrinsic and efficient components that operate directly in hyperbolic space. In this work, we lift two core components of neural networks, Multinomial Logistic Regression (MLR) and Fully Connected (FC) layers, into hyperbolic space via Busemann functions, resulting in Busemann MLR (BMLR) and Busemann FC (BFC) layers with a unified mathematical interpretation. BMLR provides compact parameters, a point-to-horosphere distance interpretation, batch-efficient computation, and a Euclidean limit, while BFC generalizes FC and activation layers with comparable complexity. Experiments on image classification, genome sequence learning, node classification, and link prediction demonstrate improvements in effectiveness and efficiency over prior hyperbolic layers. The code is available at https://github.com/GitZH-Chen/HBNN .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper35
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 被引用 791 次
- Constant Curvature Graph Convolutional NetworksGregor Bachmann, Gary Bécigneul, Octavian GaneaICML 2020 · 被引用 169 次
- Hyperbolic Image-text RepresentationsKaran Desai, Maximilian Nickel, Tanmay Rajpurohit, Justin Johnson 等ICML 2023 · 被引用 137 次
- Mixed-curvature Variational AutoencodersOndrej Skopek, Octavian-Eugen Ganea, Gary BécigneulICLR 2020 · 被引用 122 次
- Hyperbolic Vision Transformers: Combining Improvements in Metric LearningAleksandr Ermolov, Leyla Mirvakhabova, Valentin Khrulkov, Nicu Sebe 等CVPR 2022 · 被引用 97 次
相关 Paper
- Fully Hyperbolic Convolutional Neural Networks for Computer VisionAhmad Bdeir, Kristian Schwethelm, Niels LandwehrICLR 2024 · 被引用 45 次
- Proper Velocity Neural NetworksZiheng Chen, Zihan Su, Bernhard Schölkopf, Nicu SebeICLR 2026
- Intrinsic Lorentz Neural NetworkXianglong Shi, Ziheng Chen, Yunhan Jiang, Nicu SebeICLR 2026 · 被引用 3 次
- Random Laplacian Features for Learning with Hyperbolic SpaceTao Yu, Christopher De SaICLR 2023 · 被引用 1 次
- Hyperbolic Busemann Learning with Ideal PrototypesMina Ghadimi Atigh, Martin Keller-Ressel, Pascal MettesNeurIPS 2021 · 被引用 68 次
