Parameterless Transductive Feature Re-representation for Few-Shot Learning
Wentao Cui, Yuhong Guo
Abstract
Recent literature in few-shot learning (FSL) has shown that transductive methods often outperform their inductive counterparts. However, most transductive solutions, particularly the meta-learning based ones, require inserting trainable parameters on top of some inductive baselines to facilitate transduction. In this paper, we propose a parameterless transductive feature re-representation framework that differs from all existing solutions from the following perspectives. (1) It is widely compatible with existing FSL methods, including meta-learning and fine tuning based models. (2) The framework is simple and introduces no extra training parameters when applied to any architecture. We conduct experiments on three benchmark datasets by applying the framework to both representative meta-learning baselines and state-ofthe-art FSL methods. Our framework consistently improves performances in all experiments and refreshes the state-of-the-art FSL results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ae6bc7fd-b7b1-48ab-9baf-fde925549f7cCited by top-tier papers4
- Towards Practical Few-shot Query Sets: Transductive Minimum Description Length InferenceSégolène Martin, Malik Boudiaf, Emilie Chouzenoux, Jean-Christophe Pesquet et al.NeurIPS 2022 · 13 citations
- BECLR: Batch Enhanced Contrastive Few-Shot LearningStylianos Poulakakis-Daktylidis, Hadi Jamali RadICLR 2024 · 10 citations
- Improving Task-Specific Generalization in Few-Shot Learning via Adaptive Vicinal Risk MinimizationLong-Kai Huang, Ying WeiNeurIPS 2022 · 1 citation
- Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-Shot Learning with Hyperspherical EmbeddingsDaniel J. Trosten, Rwiddhi Chakraborty, Sigurd Løkse, Kristoffer Knutsen Wickstrøm et al.CVPR 2023
Builds on8
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Cross-Domain Few-Shot Classification via Learned Feature-Wise TransformationHung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang, Ming-Hsuan YangICLR 2020 · 467 citations
- Boosting Few-Shot Visual Learning With Self-SupervisionSpyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez et al.ICCV 2019 · 445 citations
- CrossTransformers: spatially-aware few-shot transferCarl Doersch, Ankush Gupta, Andrew ZissermanNeurIPS 2020 · 420 citations
Related papers
- The Role of Global Labels in Few-Shot Classification and How to Infer ThemRuohan Wang, Massimiliano Pontil, Carlo CilibertoNeurIPS 2021 · 18 citations
- Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot TasksMicah Goldblum, Steven Reich, Liam Fowl, Renkun Ni et al.ICML 2020 · 82 citations
- Information Maximization for Few-Shot LearningMalik Boudiaf, Imtiaz Masud Ziko, Jérôme Rony, Jose Dolz et al.NeurIPS 2020 · 136 citations
- ConFeSS: A Framework for Single Source Cross-Domain Few-Shot LearningDebasmit Das, Sungrack Yun, Fatih PorikliICLR 2022 · 57 citations
- Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot LearningMamshad Nayeem Rizve, Salman H. Khan, Fahad Shahbaz Khan, Mubarak ShahCVPR 2021
