Few-Shot Learning With Embedded Class Models and Shot-Free Meta Training
Avinash Ravichandran, Rahul Bhotika, Stefano Soatto
Abstract
We propose a method for learning embeddings for fewshot learning that is suitable for use with any number of shots (shot-free). Rather than fixing the class prototypes to be the Euclidean average of sample embeddings, we allow them to live in a higher-dimensional space (embedded class models) and learn the prototypes along with the model parameters. The class representation function is defined implicitly, which allows us to deal with a variable number of shots per class with a simple constant-size architecture. The class embedding encompasses metric learning, that facilitates adding new classes without crowding the class representation space. Despite being general and not tuned to the benchmark, our approach achieves state-of-the-art performance on the standard few-shot benchmark datasets. Figure 1 . One image of a mushroom (Muscaria) may be enough to recognize it in the wild (left); in other cases, there may be more subtle differences between an edible (Russula, shown in the center) and a deadly one (Phalloides, shown on the right), but still few samples are enough for humans.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 01a3dac7-25b6-4dfe-a900-d4666243408eCited by top-tier papers35
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Relational Embedding for Few-Shot ClassificationDahyun Kang, Heeseung Kwon, Juhong Min, Minsu ChoICCV 2021 · 254 citations
- Z-Score Normalization, Hubness, and Few-Shot LearningNanyi Fei, Yizhao Gao, Zhiwu Lu, Tao XiangICCV 2021 · 158 citations
- On Episodes, Prototypical Networks, and Few-Shot LearningSteinar Laenen, Luca BertinettoNeurIPS 2021 · 142 citations
- On the Role of Neural Collapse in Transfer LearningTomer Galanti, András György, Marcus HutterICLR 2022 · 114 citations
Related papers
- Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot LearningYinbo Chen, Zhuang Liu, Huijuan Xu, Trevor Darrell et al.ICCV 2021 · 455 citations
- Curvature Generation in Curved Spaces for Few-Shot LearningZhi Gao, Yuwei Wu, Yunde Jia, Mehrtash HarandiICCV 2021 · 71 citations
- Few-Shot Learning via Embedding Adaptation With Set-to-Set FunctionsHan-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei ShaCVPR 2020
- A Theoretical Analysis of the Number of Shots in Few-Shot LearningTianshi Cao, Marc T. Law, Sanja FidlerICLR 2020 · 75 citations
- Variational Few-Shot LearningJian Zhang, Chenglong Zhao, Bingbing Ni, Minghao Xu et al.ICCV 2019 · 167 citations
