Partner-Assisted Learning for Few-Shot Image Classification
Jiawei Ma, Hanchen Xie, Guangxing Han, Shih-Fu Chang, Aram Galstyan, Wael Abd-Almageed
Abstract
Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning methods, how to train a feature extractor is still a challenge. In this paper, we focus on the design of training strategy to obtain an elemental representation such that the prototype of each novel class can be estimated from a few labeled samples. We propose a two-stage training scheme, Partner-Assisted Learning (PAL), which first trains a Partner Encoder to model pair-wise similarities and extract features serving as soft-anchors, and then trains a Main Encoder by aligning its outputs with soft-anchors while attempting to maximize classification performance. Two alignment constraints from logit-level and feature-level are designed individually. For each few-shot task, we perform prototype classification. Our method consistently outperforms the state-of-the-art methods on four benchmarks. Detailed ablation studies of PAL are provided to justify the selection of each component involved in training.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bd1d8d33-248d-4858-9634-9bf36dfa219fCited by top-tier papers15
- Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature AlignmentGuangxing Han, Shiyuan Huang, Jiawei Ma, Yicheng He et al.AAAI 2022 · 227 citations
- Few-Shot Object Detection with Fully Cross-TransformerGuangxing Han, Jiawei Ma, Shiyuan Huang, Long Chen et al.CVPR 2022 · 183 citations
- Query Adaptive Few-Shot Object Detection with Heterogeneous Graph Convolutional NetworksGuangxing Han, Yicheng He, Shiyuan Huang, Jiawei Ma et al.ICCV 2021 · 134 citations
- Rethinking Generalization in Few-Shot ClassificationMarkus Hiller, Rongkai Ma, Mehrtash Harandi, Tom DrummondNeurIPS 2022 · 119 citations
- Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot LearningYangji He, Weihan Liang, Dongyang Zhao, Hong-Yu Zhou et al.CVPR 2022 · 58 citations
Builds on12
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Big Self-Supervised Models are Strong Semi-Supervised LearnersTing Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi et al.NeurIPS 2020 · 2,611 citations
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Boosting Few-Shot Visual Learning With Self-SupervisionSpyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez et al.ICCV 2019 · 445 citations
- Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature AlignmentGuangxing Han, Shiyuan Huang, Jiawei Ma, Yicheng He et al.AAAI 2022 · 227 citations
Related papers
- Prototype Completion With Primitive Knowledge for Few-Shot LearningBaoquan Zhang, Xutao Li, Yunming Ye, Zhichao Huang et al.CVPR 2021
- Adaptive FSS: A Novel Few-Shot Segmentation Framework via Prototype EnhancementJing Wang, Jiangyun Li, Chen Chen, Yisi Zhang et al.AAAI 2024 · 24 citations
- TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot LearningZhongjie Yu, Lin Chen, Zhongwei Cheng, Jiebo LuoCVPR 2020
- Fine-Grained Prototypes Distillation for Few-Shot Object DetectionZichen Wang, Bo Yang, Haonan Yue, Zhenghao MaAAAI 2024 · 55 citations
- Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot TasksMicah Goldblum, Steven Reich, Liam Fowl, Renkun Ni et al.ICML 2020 · 82 citations
