PTN: A Poisson Transfer Network for Semi-supervised Few-shot Learning
Huaxi Huang, Junjie Zhang, Jian Zhang, Qiang Wu, Chang Xu
Abstract
The predicament in semi-supervised few-shot learning (SS-FSL) is to maximize the value of the extra unlabeled data to boost the few-shot learner. In this paper, we propose a Poisson Transfer Network (PTN) to mine the unlabeled information for SSFSL from two aspects. First, the Poisson Merriman-Bence-Osher (MBO) model builds a bridge for the communications between labeled and unlabeled examples. This model serves as a more stable and informative classifier than traditional graph-based SSFSL methods in the message-passing process of the labels. Second, the extra unlabeled samples are employed to transfer the knowledge from base classes to novel classes through contrastive learning. Specifically, we force the augmented positive pairs close while push the negative ones distant. Our contrastive transfer scheme implicitly learns the novel-class embeddings to alleviate the over-fitting problem on the few labeled data. Thus, we can mitigate the degeneration of embedding generality in novel classes. Extensive experiments indicate that PTN outperforms the state-of-the-art few-shot and SSFSL models on miniImageNet and tieredImageNet benchmark datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext acb1a9db-8bf8-4b8b-bd87-85567688ed35Cited by top-tier papers4
- Iterative label cleaning for transductive and semi-supervised few-shot learningMichalis Lazarou, Tania Stathaki, Yannis AvrithisICCV 2021 · 82 citations
- EASE: Unsupervised Discriminant Subspace Learning for Transductive Few-Shot LearningHao Zhu, Piotr KoniuszCVPR 2022 · 54 citations
- Semi-Supervised Few-shot Learning via Multi-Factor ClusteringJie Ling, Lei Liao, Meng Yang, Jia ShuaiCVPR 2022 · 23 citations
- PLATINUM: Semi-Supervised Model Agnostic Meta-Learning using Submodular Mutual InformationChangbin Li, Suraj Kothawade, Feng Chen, Rishabh K. IyerICML 2022 · 6 citations
Builds on8
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Laplacian Regularized Few-Shot LearningImtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben AyedICML 2020 · 205 citations
- Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label RatesJeff Calder, Brendan Cook, Matthew Thorpe, Dejan SlepcevICML 2020 · 101 citations
- TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot LearningZhongjie Yu, Lin Chen, Zhongwei Cheng, Jiebo LuoCVPR 2020
Related papers
- Transductive Few-Shot Learning with Prototype-Based Label Propagation by Iterative Graph RefinementHao Zhu, Piotr KoniuszCVPR 2023
- Transferable Contrastive Network for Generalized Zero-Shot LearningHuajie Jiang, Ruiping Wang, Shiguang Shan, Xilin ChenICCV 2019 · 200 citations
- Few-shot Learning with Noisy LabelsKevin J. Liang, Samrudhdhi B. Rangrej, Vladan Petrovic, Tal HassnerCVPR 2022 · 46 citations
- Knowledge Graph Transfer Network for Few-Shot RecognitionRiquan Chen, Tianshui Chen, Xiaolu Hui, Hefeng Wu et al.AAAI 2020 · 69 citations
- Contrastive Graph Poisson Networks: Semi-Supervised Learning with Extremely Limited LabelsSheng Wan, Yibing Zhan, Liu Liu, Baosheng Yu et al.NeurIPS 2021 · 71 citations
