Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels
Shu-Lin Xu, Yifan Sun, Faen Zhang, Anqi Xu, Xiu-Shen Wei, Yi Yang
Abstract
Learning fine-grained embeddings from coarse labels is a challenging task due to limited label granularity supervision, i.e., lacking the detailed distinctions required for fine-grained tasks. The task becomes even more demanding when attempting few-shot fine-grained recognition, which holds practical significance in various applications. To address these challenges, we propose a novel method that embeds visual embeddings into a hyperbolic space and enhances their discriminative ability with a hierarchical cosine margins manner. Specifically, the hyperbolic space offers distinct advantages, including the ability to capture hierarchical relationships and increased expressive power, which favors modeling fine-grained objects. Based on the hyperbolic space, we further enforce relatively large/small similarity margins between coarse/fine classes, respectively, yielding the so-called hierarchical cosine margins manner. While enforcing similarity margins in the regular Euclidean space has become popular for deep embedding learning, applying it to the hyperbolic space is non-trivial and validating the benefit for coarse-to-fine generalization is valuable. Extensive experiments conducted on five benchmark datasets showcase the effectiveness of our proposed method, yielding state-of-the-art results surpassing competing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4997df36-94d7-4123-9002-ac5666dafe46Cited by top-tier papers7
- A Simple yet Universal Framework for Depth CompletionJin-Hwi Park, Hae-Gon JeonNeurIPS 2024 · 17 citations
- Learning Fine-grained Domain Generalization via Hyperbolic State Space HallucinationQi Bi, Jingjun Yi, Haolan Zhan, Wei Ji et al.AAAI 2025 · 8 citations
- Twofold Debiasing Enhances Fine-Grained Learning with Coarse LabelsXin-yang Zhao, Jian Jin, Yangyang Li, Yazhou YaoAAAI 2025 · 2 citations
- Learning Separable Fine-Grained Representation via Dendrogram Construction from Coarse Labels for Fine-grained Visual RecognitionGuanghui Shi, Xuefeng Liang, Wenjie Li, Xiaoyu LinICCV 2025 · 2 citations
- TellWhisper: Tell Whisper Who Speaks WhenYifan Hu, Peiji Yang, Zhisheng Wang, Yicheng Zhong et al.ACL 2026 · 1 citation
Builds on18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification ProblemsNimit Sharad Sohoni, Jared Dunnmon, Geoffrey Angus, Albert Gu et al.NeurIPS 2020 · 316 citations
- BREEDS: Benchmarks for Subpopulation ShiftShibani Santurkar, Dimitris Tsipras, Aleksander MadryICLR 2021 · 193 citations
Related papers
- Hyperbolic Image EmbeddingsValentin Khrulkov, Leyla Mirvakhabova, Evgeniya Ustinova, Ivan V. Oseledets et al.CVPR 2020
- Hyperbolic Visual Embedding Learning for Zero-Shot RecognitionShaoteng Liu, Jingjing Chen, Liangming Pan, Chong-Wah Ngo et al.CVPR 2020
- Label-Aware Hyperbolic Embeddings for Fine-grained Emotion ClassificationChih-Yao Chen, Tun-Min Hung, Yi-Li Hsu, Lun-Wei KuACL 2023 · 6 citations
- Curvature Generation in Curved Spaces for Few-Shot LearningZhi Gao, Yuwei Wu, Yunde Jia, Mehrtash HarandiICCV 2021 · 71 citations
- Towards Cross-Granularity Few-Shot Learning: Coarse-to-Fine Pseudo-Labeling with Visual-Semantic Meta-EmbeddingJinhai Yang, Hua Yang, Lin ChenACM MM 2021 · 16 citations
