Adaptive Hyperbolic Kernels: Modulated Embedding in de Branges-Rovnyak Spaces
Leping Si, Meimei Yang, Hui Xue, Shipeng Zhu, Pengfei Fang
摘要
Hierarchical data pervades diverse machine learning applications, including natural language processing, computer vision, and social network analysis. Hyperbolic space, characterized by its negative curvature, has demonstrated strong potential in such tasks due to its capacity to embed hierarchical structures with minimal distortion. Previous evidence indicates that the hyperbolic representation capacity can be further enhanced through kernel methods. However, existing hyperbolic kernels still suffer from mild geometric distortion or lack adaptability. This paper addresses these issues by introducing a curvature-aware de Branges–Rovnyak space, a reproducing kernel Hilbert space (RKHS) that is isometric to a Poincaré ball. We design an adjustable multiplier to select the appropriate RKHS corresponding to the hyperbolic space with any curvature adaptively. Building on this foundation, we further construct a family of adaptive hyperbolic kernels, including the novel adaptive hyperbolic radial kernel, whose learnable parameters modulate hyperbolic features in a task-aware manner. Extensive experiments on visual and language benchmarks demonstrate that our proposed kernels outperform existing hyperbolic kernels in modeling hierarchical dependencies.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 被引用 2,496 次
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 被引用 791 次
- Rethinking Zero-Shot Learning: A Conditional Visual Classification PerspectiveKai Li, Martin Renqiang Min, Yun FuICCV 2019 · 被引用 151 次
- Kernel Methods in Hyperbolic SpacesPengfei Fang, Mehrtash Harandi, Lars PeterssonICCV 2021 · 被引用 53 次
- Fully Hyperbolic Convolutional Neural Networks for Computer VisionAhmad Bdeir, Kristian Schwethelm, Niels LandwehrICLR 2024 · 被引用 45 次
相关 Paper
- Robust Hyperbolic Learning with Curvature-Aware OptimizationAhmad Bdeir, Johannes Burchert, Lars Schmidt-Thieme, Niels LandwehrNeurIPS 2025 · 被引用 4 次
- Hyperbolic Associative Memory NetworksBoliang Hao, Bailing Zhang, Fangyu WuICML 2026
- FisheyeHDK: Hyperbolic Deformable Kernel Learning for Ultra-Wide Field-of-View Image RecognitionOla Ahmad, Freddy LécuéAAAI 2022 · 被引用 21 次
- Geometry Interaction Knowledge Graph EmbeddingsZongsheng Cao, Qianqian Xu, Zhiyong Yang, Xiaochun Cao 等AAAI 2022 · 被引用 81 次
- Random Laplacian Features for Learning with Hyperbolic SpaceTao Yu, Christopher De SaICLR 2023 · 被引用 1 次
