Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?
Malik Boudiaf, Hoel Kervadec, Imtiaz Masud Ziko, Pablo Piantanida, Ismail Ben Ayed, Jose Dolz
Abstract
We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances-an aspect often overlooked in the literature in favor of the meta-learning paradigm. We introduce a transductive inference for a given query image, leveraging the statistics of its unlabeled pixels, by optimizing a new loss containing three complementary terms: i) the crossentropy on the labeled support pixels; ii) the Shannon entropy of the posteriors on the unlabeled query-image pixels; and iii) a global KL-divergence regularizer based on the proportion of the predicted foreground. As our inference uses a simple linear classifier of the extracted features, its computational load is comparable to inductive inference and can be used on top of any base training. Foregoing episodic training and using only standard cross-entropy training on the base classes, our inference yields competitive performances on standard benchmarks in the 1-shot scenarios. As the number of available shots increases, the gap in performances widens: on PASCAL-5 i , our method brings about 5% and 6% improvements over the state-ofthe-art, in the 5-and 10-shot scenarios, respectively. Furthermore, we introduce a new setting that includes domain shifts, where the base and novel classes are drawn from different datasets. Our method achieves the best performances in this more realistic setting. Our code is freely available online: https://github.com/mboudiaf/ RePRI-for-Few-Shot-Segmentation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers54
- Language-driven Semantic SegmentationBoyi Li, Kilian Q. Weinberger, Serge J. Belongie, Vladlen Koltun et al.ICLR 2022 · 885 citations
- Image Segmentation Using Text and Image PromptsTimo Lüddecke, Alexander S. EckerCVPR 2022 · 457 citations
- Hypercorrelation Squeeze for Few-Shot SegmenationJuhong Min, Dahyun Kang, Minsu ChoICCV 2021 · 413 citations
- Mining Latent Classes for Few-shot SegmentationLihe Yang, Wei Zhuo, Lei Qi, Yinghuan Shi et al.ICCV 2021 · 152 citations
- Learning Non-target Knowledge for Few-shot Semantic SegmentationYuanwei Liu, Nian Liu, Qinglong Cao, Xiwen Yao et al.CVPR 2022 · 132 citations
Builds on10
- PANet: Few-Shot Image Semantic Segmentation With Prototype AlignmentKaixin Wang, Jun Hao Liew, Yingtian Zou, Daquan Zhou et al.ICCV 2019 · 1,404 citations
- A Baseline for Few-Shot Image ClassificationGuneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano SoattoICLR 2020 · 640 citations
- Feature Weighting and Boosting for Few-Shot SegmentationKhoi Nguyen, Sinisa TodorovicICCV 2019 · 402 citations
- Pyramid Graph Networks With Connection Attentions for Region-Based One-Shot Semantic SegmentationChi Zhang, Guosheng Lin, Fayao Liu, Jiushuang Guo et al.ICCV 2019 · 351 citations
- AMP: Adaptive Masked Proxies for Few-Shot SegmentationMennatullah Siam, Boris N. Oreshkin, Martin JägersandICCV 2019 · 211 citations
Related papers
- Realistic evaluation of transductive few-shot learningOlivier Veilleux, Malik Boudiaf, Pablo Piantanida, Ismail Ben AyedNeurIPS 2021 · 55 citations
- A Strong Baseline for Generalized Few-Shot Semantic SegmentationSina Hajimiri, Malik Boudiaf, Ismail Ben Ayed, Jose DolzCVPR 2023
- A Surprisingly Simple Approach to Generalized Few-Shot Semantic SegmentationTomoya Sakai, Haoxiang Qiu, Takayuki Katsuki, Daiki Kimura et al.NeurIPS 2024 · 7 citations
- Laplacian Regularized Few-Shot LearningImtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben AyedICML 2020 · 205 citations
- Information Maximization for Few-Shot LearningMalik Boudiaf, Imtiaz Masud Ziko, Jérôme Rony, Jose Dolz et al.NeurIPS 2020 · 136 citations
