WeditGAN: Few-Shot Image Generation via Latent Space Relocation
Yuxuan Duan, Li Niu, Yan Hong, Liqing Zhang
Abstract
In few-shot image generation, directly training GAN models on just a handful of images faces the risk of overfitting. A popular solution is to transfer the models pretrained on large source domains to small target ones. In this work, we introduce WeditGAN, which realizes model transfer by editing the intermediate latent codes w in StyleGANs with learned constant offsets (delta w), discovering and constructing target latent spaces via simply relocating the distribution of source latent spaces. The established one-to-one mapping between latent spaces can naturally prevents mode collapse and overfitting. Besides, we also propose variants of WeditGAN to further enhance the relocation process by regularizing the direction or finetuning the intensity of delta w. Experiments on a collection of widely used source/target datasets manifest the capability of WeditGAN in generating realistic and diverse images, which is simple yet highly effective in the research area of few-shot image generation. Codes are available at https://github.com/Ldhlwh/WeditGAN.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8fc36d50-960d-4c39-95bc-e757e1524612Cited by top-tier papers3
- Transfer Learning for Diffusion ModelsYidong Ouyang, Liyan Xie, Hongyuan Zha, Guang ChengNeurIPS 2024 · 17 citations
- DomainGallery: Few-shot Domain-driven Image Generation by Attribute-centric FinetuningYuxuan Duan, Yan Hong, Bo Zhang, Jun Lan et al.NeurIPS 2024 · 2 citations
- Few-shot Implicit Function Generation via EquivarianceSuizhi Huang, Xingyi Yang, Hongtao Lu, Xinchao WangCVPR 2025
Builds on28
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- StyleCLIP: Text-Driven Manipulation of StyleGAN ImageryOr Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or et al.ICCV 2021 · 1,437 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
- Designing an encoder for StyleGAN image manipulationOmer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik et al.SIGGRAPH 2021 · 692 citations
Related papers
- Few-shot Cross-domain Image Generation via Inference-time Latent-code LearningArnab Kumar Mondal, Piyush Tiwary, Parag Singla, Prathosh APICLR 2023
- Attribute Group Editing for Reliable Few-shot Image GenerationGuanqi Ding, Xinzhe Han, Shuhui Wang, Shuzhe Wu et al.CVPR 2022 · 36 citations
- FEditNet: Few-Shot Editing of Latent Semantics in GAN SpacesMengfei Xia, Yezhi Shu, Yuji Wang, Yu-Kun Lai et al.AAAI 2023 · 4 citations
- DeltaEdit: Exploring Text-free Training for Text-Driven Image ManipulationCVPR 2023
- Few-shot Image Generation with Elastic Weight ConsolidationYijun Li, Richard Zhang, Jingwan Lu, Eli ShechtmanNeurIPS 2020 · 193 citations
