Prototypes-oriented Transductive Few-shot Learning with Conditional Transport
Long Tian, Jingyi Feng, Xiaoqiang Chai, Wenchao Chen, Liming Wang, Xiyang Liu, Bo Chen
Abstract
Transductive Few-Shot Learning (TFSL) has recently attracted increasing attention since it typically outperforms its inductive peer by leveraging statistics of query samples. However, previous TFSL methods usually encode uniform prior that all the classes within query samples are equally likely, which is biased in imbalanced TFSL and causes severe performance degradation. Given this pivotal issue, in this work, we propose a novel Conditional Transport (CT) based imbalanced TFSL model called Prototypes-oriented Unbiased Transfer Model (PUTM) to fully exploit unbiased statistics of imbalanced query samples, which employs forward and backward navigators as transport matrices to balance the prior of query samples per class between uniform and adaptive data-driven distributions. For efficiently transferring statistics learned by CT, we further derive a closed form solution to refine prototypes based on MAP given the learned navigators. The above two steps of discovering and transferring unbiased statistics follow an iterative manner, formulating our EM-based solver. Experimental results on four standard benchmarks including miniImageNet, tiered-ImageNet, CUB, and CIFAR-FS demonstrate superiority of our model in class-imbalanced generalization 1.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f9f8b526-c1d6-4290-a80b-db65df5d8241Cited by top-tier papers8
- Enhancing Minority Classes by Mixing: An Adaptative Optimal Transport Approach for Long-tailed ClassificationJintong Gao, He Zhao, Zhuo Li, Dandan GuoNeurIPS 2023 · 64 citations
- PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image ClassificationMiaoge Li, Dongsheng Wang, Xinyang Liu, Zequn Zeng et al.ICCV 2023 · 30 citations
- MetaCoCo: A New Few-Shot Classification Benchmark with Spurious CorrelationMin Zhang, Haoxuan Li, Fei Wu, Kun KuangICLR 2024 · 18 citations
- Transductive Zero-Shot and Few-Shot CLIPSégolène Martin, Yunshi Huang, Fereshteh Shakeri, Jean-Christophe Pesquet et al.CVPR 2024 · 17 citations
- STiTch: Semantic Transition and Transportation in Collaboration for Training-Free Zero-Shot Composed Image RetrievalMiaoge Li, Dongsheng Wang, Zening Sun, Jinsen Zhang et al.CVPR 2026 · 2 citations
Builds on12
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Free Lunch for Few-shot Learning: Distribution CalibrationShuo Yang, Lu Liu, Min XuICLR 2021 · 378 citations
- Laplacian Regularized Few-Shot LearningImtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben AyedICML 2020 · 205 citations
- Information Maximization for Few-Shot LearningMalik Boudiaf, Imtiaz Masud Ziko, Jérôme Rony, Jose Dolz et al.NeurIPS 2020 · 136 citations
- Iterative label cleaning for transductive and semi-supervised few-shot learningMichalis Lazarou, Tania Stathaki, Yannis AvrithisICCV 2021 · 82 citations
Related papers
- Transductive Few-Shot Learning with Prototype-Based Label Propagation by Iterative Graph RefinementHao Zhu, Piotr KoniuszCVPR 2023
- Boosting Transductive Few-Shot Fine-tuning with Margin-based Uncertainty Weighting and Probability RegularizationRan Tao, Hao Chen, Marios SavvidesCVPR 2023
- Adaptive Distribution Calibration for Few-Shot Learning with Hierarchical Optimal TransportDandan Guo, Long Tian, He Zhao, Mingyuan Zhou et al.NeurIPS 2022 · 39 citations
- Realistic evaluation of transductive few-shot learningOlivier Veilleux, Malik Boudiaf, Pablo Piantanida, Ismail Ben AyedNeurIPS 2021 · 55 citations
- TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot LearningZhongjie Yu, Lin Chen, Zhongwei Cheng, Jiebo LuoCVPR 2020
