Relational Embedding for Few-Shot Classification
Dahyun Kang, Heeseung Kwon, Juhong Min, Minsu Cho
Abstract
We propose to address the problem of few-shot classification by meta-learning "what to observe" and "where to attend" in a relational perspective. Our method lever-ages relational patterns within and between images via self-correlational representation (SCR) and cross-correlational attention (CCA). Within each image, the SCR module transforms a base feature map into a self-correlation tensor and learns to extract structural patterns from the tensor. Between the images, the CCA module computes cross-correlation between two image representations and learns to produce co-attention between them. Our Relational Embedding Network (RENet) combines the two relational modules to learn relational embedding in an end-to-end manner. In experimental evaluation, it achieves consistent improvements over state-of-the-art methods on four widely used few-shot classification benchmarks of miniImageNet, tieredImageNet, CUB-200-2011, and CIFAR-FS.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers32
- Rethinking Generalization in Few-Shot ClassificationMarkus Hiller, Rongkai Ma, Mehrtash Harandi, Tom DrummondNeurIPS 2022 · 119 citations
- Task Discrepancy Maximization for Fine-grained Few-Shot ClassificationSu Been Lee, WonJun Moon, Jae-Pil HeoCVPR 2022 · 82 citations
- Integrative Few-Shot Learning for Classification and SegmentationDahyun Kang, Minsu ChoCVPR 2022 · 76 citations
- Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot LearningYangji He, Weihan Liang, Dongyang Zhao, Hong-Yu Zhou et al.CVPR 2022 · 58 citations
- Class-Aware Patch Embedding Adaptation for Few-Shot Image ClassificationFusheng Hao, Fengxiang He, Liu Liu, Fuxiang Wu et al.ICCV 2023 · 56 citations
Builds on20
- Video Object Segmentation Using Space-Time Memory NetworksSeoung Wug Oh, Joon-Young Lee, Ning Xu, Seon Joo KimICCV 2019 · 845 citations
- Frustratingly Simple Few-Shot Object DetectionXin Wang, Thomas E. Huang, Joseph Gonzalez, Trevor Darrell et al.ICML 2020 · 723 citations
- Boosting Few-Shot Visual Learning With Self-SupervisionSpyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez et al.ICCV 2019 · 445 citations
- CrossTransformers: spatially-aware few-shot transferCarl Doersch, Ankush Gupta, Andrew ZissermanNeurIPS 2020 · 420 citations
- Laplacian Regularized Few-Shot LearningImtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben AyedICML 2020 · 205 citations
Related papers
- PARN: Position-Aware Relation Networks for Few-Shot LearningZiyang Wu, Yuwei Li, Lihua Guo, Kui JiaICCV 2019 · 96 citations
- Dual Attention Networks for Few-Shot Fine-Grained RecognitionShu-Lin Xu, Faen Zhang, Xiu-Shen Wei, Jianhua WangAAAI 2022 · 43 citations
- CAD: Co-Adapting Discriminative Features for Improved Few-Shot ClassificationPhilip Chikontwe, Soopil Kim, Sang Hyun ParkCVPR 2022 · 46 citations
- Matching Feature Sets for Few-Shot Image ClassificationArman Afrasiyabi, Hugo Larochelle, Jean-François Lalonde, Christian GagnéCVPR 2022 · 124 citations
- DeepEMD: Few-Shot Image Classification With Differentiable Earth Mover's Distance and Structured ClassifiersChi Zhang, Yujun Cai, Guosheng Lin, Chunhua ShenCVPR 2020
