EASE: Unsupervised Discriminant Subspace Learning for Transductive Few-Shot Learning
Hao Zhu, Piotr Koniusz
Abstract
Few-shot learning (FSL) has received a lot of attention due to its remarkable ability to adapt to novel classes. Although many techniques have been proposed for FSL, they mostly focus on improving FSL backbones. Some works also focus on learning on top of the features generated by these backbones to adapt them to novel classes. We present an unsupErvised discriminAnt Subspace lEarning (EASE) that improves transductive few-shot learning performance by learning a linear projection onto a subspace built from features of the support set and the unlabeled query set in the test time. Specifically, based on the support set and the unlabeled query set, we generate the similarity matrix and the dissimilarity matrix based on the structure prior for the proposed EASE method, which is efficiently solved with SVD. We also introduce conStraIned wAsserstein MEan Shift clustEring (SIAMESE) which extends Sinkhorn K-means by incorporating labeled support samples. SIAMESE works on the features obtained from EASE to estimate class centers and query predictions. On the mini-ImageNet, tiered-ImageNet, CIFAR-FS, CUB and OpenMIC benchmarks, both steps significantly boost the performance in transductive FSL and semi-supervised FSL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 628aa9e7-6d02-4fe2-bab3-df096f02c392Cited by top-tier papers14
- Mitigating the Popularity Bias of Graph Collaborative Filtering: A Dimensional Collapse PerspectiveYifei Zhang, Hao Zhu, Yankai Chen, Zixing Song et al.NeurIPS 2023 · 47 citations
- Boosting Vision-Language Models with TransductionMaxime Zanella, Benoît Gérin, Ismail Ben AyedNeurIPS 2024 · 42 citations
- Generalized Laplacian EigenmapsHao Zhu, Piotr KoniuszNeurIPS 2022 · 25 citations
- Pre-training with Random Orthogonal Projection Image ModelingMaryam Haghighat, Peyman Moghadam, Shaheer Mohamed, Piotr KoniuszICLR 2024 · 15 citations
- The Balanced-Pairwise-Affinities Feature TransformDaniel Shalam, Simon KormanICML 2024 · 6 citations
Builds on17
- Semi-Supervised Domain Adaptation via Minimax EntropyKuniaki Saito, Donghyun Kim, Stan Sclaroff, Trevor Darrell et al.ICCV 2019 · 725 citations
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Laplacian Regularized Few-Shot LearningImtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben AyedICML 2020 · 205 citations
- Transductive Episodic-Wise Adaptive Metric for Few-Shot LearningLimeng Qiao, Yemin Shi, Jia Li, Yonghong Tian et al.ICCV 2019 · 196 citations
- Empirical Bayes Transductive Meta-Learning with Synthetic GradientsShell Xu Hu, Pablo Garcia Moreno, Yang Xiao, Xi Shen et al.ICLR 2020 · 139 citations
Related papers
- Transductive Few-Shot Learning with Prototype-Based Label Propagation by Iterative Graph RefinementHao Zhu, Piotr KoniuszCVPR 2023
- Cross-Domain Few-Shot Classification via Learned Feature-Wise TransformationHung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang, Ming-Hsuan YangICLR 2020 · 467 citations
- Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot LearningMamshad Nayeem Rizve, Salman H. Khan, Fahad Shahbaz Khan, Mubarak ShahCVPR 2021
- Z-Score Normalization, Hubness, and Few-Shot LearningNanyi Fei, Yizhao Gao, Zhiwu Lu, Tao XiangICCV 2021 · 158 citations
- Iterative label cleaning for transductive and semi-supervised few-shot learningMichalis Lazarou, Tania Stathaki, Yannis AvrithisICCV 2021 · 82 citations
