Curvature Generation in Curved Spaces for Few-Shot Learning
Zhi Gao, Yuwei Wu, Yunde Jia, Mehrtash Harandi
Abstract
Few-shot learning describes the challenging problem of recognizing samples from unseen classes given very few labeled examples. In many cases, few-shot learning is cast as learning an embedding space that assigns test samples to their corresponding class prototypes. Previous methods assume that data of all few-shot learning tasks comply with a fixed geometrical structure, mostly a Euclidean structure. Questioning this assumption that is clearly difficult to hold in real-world scenarios and incurs distortions to data, we propose to learn a task-aware curved embedding space by making use of the hyperbolic geometry. As a result, task-specific embedding spaces where suitable curvatures are generated to match the characteristics of data are constructed, leading to more generic embedding spaces. We then leverage on intra-class and inter-class context information in the embedding space to generate class prototypes for discriminative classification. We conduct a comprehensive set of experiments on inductive and transductive few-shot learning, demonstrating the benefits of our proposed method over existing embedding methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a24cb8fd-002f-4178-923f-4572771f263fCited by top-tier papers27
- Rethinking Generalization in Few-Shot ClassificationMarkus Hiller, Rongkai Ma, Mehrtash Harandi, Tom DrummondNeurIPS 2022 · 119 citations
- Hyperbolic Vision Transformers: Combining Improvements in Metric LearningAleksandr Ermolov, Leyla Mirvakhabova, Valentin Khrulkov, Nicu Sebe et al.CVPR 2022 · 97 citations
- Class-Aware Patch Embedding Adaptation for Few-Shot Image ClassificationFusheng Hao, Fengxiang He, Liu Liu, Fuxiang Wu et al.ICCV 2023 · 56 citations
- Hyperbolic Fine-Tuning for Large Language ModelsMenglin Yang, Ram Samarth B. B., Aosong Feng, Bo Xiong et al.NeurIPS 2025 · 31 citations
- Hyperbolic Audio-visual Zero-shot LearningJie Hong, Zeeshan Hayder, Junlin Han, Pengfei Fang et al.ICCV 2023 · 27 citations
Builds on15
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- Transductive Episodic-Wise Adaptive Metric for Few-Shot LearningLimeng Qiao, Yemin Shi, Jia Li, Yonghong Tian et al.ICCV 2019 · 196 citations
- Few-Shot Learning With Embedded Class Models and Shot-Free Meta TrainingAvinash Ravichandran, Rahul Bhotika, Stefano SoattoICCV 2019 · 191 citations
- Few-Shot Learning With Global Class RepresentationsAoxue Li, Tiange Luo, Tao Xiang, Weiran Huang et al.ICCV 2019 · 119 citations
- Revisiting Bilinear Pooling: A Coding PerspectiveZhi Gao, Yuwei Wu, Xiaoxun Zhang, Jindou Dai et al.AAAI 2020 · 37 citations
Related papers
- Adaptive Poincaré Point to Set Distance for Few-Shot ClassificationRongkai Ma, Pengfei Fang, Tom Drummond, Mehrtash HarandiAAAI 2022 · 59 citations
- Few-Shot Learning via Embedding Adaptation With Set-to-Set FunctionsHan-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei ShaCVPR 2020
- Hyperbolic Image EmbeddingsValentin Khrulkov, Leyla Mirvakhabova, Evgeniya Ustinova, Ivan V. Oseledets et al.CVPR 2020
- Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse LabelsShu-Lin Xu, Yifan Sun, Faen Zhang, Anqi Xu et al.NeurIPS 2023 · 16 citations
- von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised LearningTyler R. Scott, Andrew C. Gallagher, Michael C. MozerICCV 2021 · 56 citations
