Few-Shot Image Generation via Cross-Domain Correspondence
Utkarsh Ojha, Yijun Li, Jingwan Lu, Alexei A. Efros, Yong Jae Lee, Eli Shechtman, Richard Zhang
Abstract
Resulting generator GAN adaptation …to paintings …to babies
Figure 1: Given a model trained on a large source dataset (G s ), we propose to adapt it to arbitrary image domains, so that the resulting model (G s→t ) captures these target distributions using extremely few training samples. In the process, our method discovers a one-to-one relation between the distributions, where noise vectors map to corresponding images in the source and target. Consequently, one can imagine how a natural face would look if Amedeo Modigliani had painted it, or how the face would look in its baby form. Please see our webpage for more results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8033c986-4f7a-4f00-9f74-66c0f424e389Cited by top-tier papers92
- StyleGAN-NADA: CLIP-guided domain adaptation of image generatorsRinon Gal, Or Patashnik, Haggai Maron, Amit H. Bermano et al.SIGGRAPH 2022 · 501 citations
- Ablating Concepts in Text-to-Image Diffusion ModelsNupur Kumari, Bingliang Zhang, Sheng-Yu Wang, Eli Shechtman et al.ICCV 2023 · 327 citations
- Patch Diffusion: Faster and More Data-Efficient Training of Diffusion ModelsZhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang et al.NeurIPS 2023 · 205 citations
- AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion ModelTeng Hu, Jiangning Zhang, Ran Yi, Yuzhen Du et al.AAAI 2024 · 175 citations
- Few-Shot Defect Image Generation via Defect-Aware Feature ManipulationYuxuan Duan, Yan Hong, Li Niu, Liqing ZhangAAAI 2023 · 138 citations
Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- NVAE: A Deep Hierarchical Variational AutoencoderArash Vahdat, Jan KautzNeurIPS 2020 · 1,141 citations
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu et al.NeurIPS 2020 · 707 citations
Related papers
- Few-shot Cross-domain Image Generation via Inference-time Latent-code LearningArnab Kumar Mondal, Piyush Tiwary, Parag Singla, Prathosh APICLR 2023
- HyperDomainNet: Universal Domain Adaptation for Generative Adversarial NetworksAibek Alanov, Vadim Titov, Dmitry P. VetrovNeurIPS 2022 · 34 citations
- StyleDomain: Efficient and Lightweight Parameterizations of StyleGAN for One-shot and Few-shot Domain AdaptationAibek Alanov, Vadim Titov, Maksim Nakhodnov, Dmitry P. VetrovICCV 2023 · 13 citations
- Zero-Shot Generative Model Adaptation via Image-Specific Prompt LearningJiayi Guo, Chaofei Wang, You Wu, Eric J. Zhang et al.CVPR 2023
- One-Shot Generative Domain AdaptationCeyuan Yang, Yujun Shen, Zhiyi Zhang, Yinghao Xu et al.ICCV 2023 · 69 citations
