Semi-Supervised Learning for Few-Shot Image-to-Image Translation
Yaxing Wang, Salman H. Khan, Abel Gonzalez-Garcia, Joost van de Weijer, Fahad Shahbaz Khan
Abstract
In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Recently, some methods have tackled the challenging setting of fewshot image-to-image translation, reducing the labeled data requirements for the target domain during inference. In this work, we go one step further and reduce the amount of required labeled data also from the source domain during training. To do so, we propose applying semi-supervised learning via a noise-tolerant pseudo-labeling procedure. We also apply a cycle consistency constraint to further exploit the information from unlabeled images, either from the same dataset or external. Additionally, we propose several structural modifications to facilitate the image translation task under these circumstances. Our semi-supervised method for few-shot image translation, called SEMIT, achieves excellent results on four different datasets using as little as 10% of the source labels, and matches the performance of the main fully-supervised competitor using only 20% labeled data. Our code and models are made public at: https://github.com/yaxingwang/SEMIT .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 52ca5890-b256-43d8-acde-1c192bc9d4aeCited by top-tier papers12
- Rethinking the Truly Unsupervised Image-to-Image TranslationKyungjune Baek, Yunjey Choi, Youngjung Uh, Jaejun Yoo et al.ICCV 2021 · 115 citations
- Mixture-based Feature Space Learning for Few-shot Image ClassificationArman Afrasiyabi, Jean-François Lalonde, Christian GagnéICCV 2021 · 95 citations
- Few Shot Generative Model Adaption via Relaxed Spatial Structural AlignmentJiayu Xiao, Liang Li, Chaofei Wang, Zheng-Jun Zha et al.CVPR 2022 · 69 citations
- Attribute Group Editing for Reliable Few-shot Image GenerationGuanqi Ding, Xinzhe Han, Shuhui Wang, Shuzhe Wu et al.CVPR 2022 · 36 citations
- AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style TransferJoonwoo Kwon, Sooyoung Kim, Yuewei Lin, Shinjae Yoo et al.AAAI 2024 · 32 citations
Builds on2
- Few-Shot Unsupervised Image-to-Image TranslationMing-Yu Liu, Xun Huang, Arun Mallya, Tero Karras et al.ICCV 2019 · 668 citations
- Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave ConvolutionYunpeng Chen, Haoqi Fan, Bing Xu, Zhicheng Yan et al.ICCV 2019 · 665 citations
Related papers
- OA-FSUI2IT: A Novel Few-Shot Cross Domain Object Detection Framework with Object-Aware Few-Shot Unsupervised Image-to-Image TranslationLifan Zhao, Yunlong Meng, Lin XuAAAI 2022 · 4 citations
- PseudoSeg: Designing Pseudo Labels for Semantic SegmentationYuliang Zou, Zizhao Zhang, Han Zhang, Chun-Liang Li et al.ICLR 2021 · 364 citations
- Cut out the annotator, keep the cutout: better segmentation with weak supervisionSarah M. Hooper, Michael Wornow, Ying Hang Seah, Peter Kellman et al.ICLR 2021 · 17 citations
- Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image TranslationYupei Lin, Sen Zhang, Tianshui Chen, Yongyi Lu et al.ACM MM 2022 · 19 citations
- Semi-Supervised Learning of Semantic Correspondence with Pseudo-LabelsJiwon Kim, Kwangrok Ryoo, Junyoung Seo, Gyuseong Lee et al.CVPR 2022 · 23 citations
