Learning Intact Features by Erasing-Inpainting for Few-shot Classification
Junjie Li, Zilei Wang, Xiaoming Hu
Abstract
Few-shot classification aims to categorize the samples from unseen classes with only few labeled samples. To address such a challenge, many methods exploit a base set consisting of massive labeled samples to learn an instance embedding function, i.e., image feature extractor, and it is expected to possess good transferability among different tasks. Such characteristics of few-shot learning are essentially different from that of traditional image classification only pursuing to get discriminative image representations. In this paper, we propose to learn intact features by erasing-inpainting for few-shot classification. Specifically, we argue that extracting intact features of target objects is more transferable, and then propose a novel cross-set erasing-inpainting (CSEI) method. CSEI processes the images in the support set using erasing and inpainting, and then uses them to augment the query set of the same task. Consequently, the feature embedding produced by our proposed method can contain more complete information of target objects. In addition, we propose task-specific feature modulation to make the features adaptive to the current task. The extensive experiments on two widely used benchmarks well demonstrates the effectiveness of our proposed method, which can consistently get considerable performance gains for different baseline methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- Mixture-based Feature Space Learning for Few-shot Image ClassificationArman Afrasiyabi, Jean-François Lalonde, Christian GagnéICCV 2021 · 95 citations
- Task Discrepancy Maximization for Fine-grained Few-Shot ClassificationSu Been Lee, WonJun Moon, Jae-Pil HeoCVPR 2022 · 82 citations
- Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot LearningYangji He, Weihan Liang, Dongyang Zhao, Hong-Yu Zhou et al.CVPR 2022 · 58 citations
- Frequency Guidance Matters in Few-Shot LearningHao Cheng, Siyuan Yang, Joey Tianyi Zhou, Lanqing Guo et al.ICCV 2023 · 48 citations
- Alleviating the Sample Selection Bias in Few-shot Learning by Removing Projection to the CentroidJing Xu, Xu Luo, Xinglin Pan, Yanan Li et al.NeurIPS 2022 · 33 citations
Builds on5
- Interventional Few-Shot LearningZhongqi Yue, Hanwang Zhang, Qianru Sun, Xian-Sheng HuaNeurIPS 2020 · 284 citations
- One-Shot Image Classification by Learning to Restore PrototypesWanqi Xue, Wei WangAAAI 2020 · 57 citations
- Adaptive Subspaces for Few-Shot LearningChristian Simon, Piotr Koniusz, Richard Nock, Mehrtash HarandiCVPR 2020
- DeepEMD: Few-Shot Image Classification With Differentiable Earth Mover's Distance and Structured ClassifiersChi Zhang, Yujun Cai, Guosheng Lin, Chunhua ShenCVPR 2020
- Few-Shot Learning via Embedding Adaptation With Set-to-Set FunctionsHan-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei ShaCVPR 2020
Related papers
- TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot LearningZhongjie Yu, Lin Chen, Zhongwei Cheng, Jiebo LuoCVPR 2020
- Integrative Few-Shot Learning for Classification and SegmentationDahyun Kang, Minsu ChoCVPR 2022 · 76 citations
- Cross-Domain Few-Shot Classification via Learned Feature-Wise TransformationHung-Yu Tseng, Hsin-Ying Lee, Jia-Bin Huang, Ming-Hsuan YangICLR 2020 · 467 citations
- Meta-Exploiting Frequency Prior for Cross-Domain Few-Shot LearningFei Zhou, Peng Wang, Lei Zhang, Zhenghua Chen et al.NeurIPS 2024 · 16 citations
- ConFeSS: A Framework for Single Source Cross-Domain Few-Shot LearningDebasmit Das, Sungrack Yun, Fatih PorikliICLR 2022 · 57 citations
