GAN Inversion for Out-of-Range Images with Geometric Transformations
Kyoungkook Kang, Seongtae Kim, Sunghyun Cho
Abstract
For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only for in-range images that align with the training images of a GAN model. In this paper, we propose BDInvert, a novel GAN inversion approach to semantic editing of out- of-range images that are geometrically unaligned with the training images of a GAN model. To find a latent code that is semantically editable, BDInvert inverts an input out-of-range image into an alternative latent space than the original latent space. We also propose a regularized inversion method to find a solution that supports semantic editing in the alternative space. Our experiments show that BDInvert effectively supports semantic editing of out-of-range images with geometric transformations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 543a1267-e728-42d8-93b5-dca4200c6044Cited by top-tier papers21
- HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image EditingYuval Alaluf, Omer Tov, Ron Mokady, Rinon Gal et al.CVPR 2022 · 250 citations
- High-Fidelity GAN Inversion for Image Attribute EditingTengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang et al.CVPR 2022 · 227 citations
- HyperInverter: Improving StyleGAN Inversion via HypernetworkTan M. Dinh, Anh Tuan Tran, Rang Nguyen, Binh-Son HuaCVPR 2022 · 111 citations
- Effective Real Image Editing with Accelerated Iterative Diffusion InversionZhihong Pan, Riccardo Gherardi, Xiufeng Xie, Stephen HuangICCV 2023 · 86 citations
- Spatially-Adaptive Multilayer Selection for GAN Inversion and EditingGaurav Parmar, Yijun Li, Jingwan Lu, Richard Zhang et al.CVPR 2022 · 40 citations
Builds on9
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
- Encoding in Style: A StyleGAN Encoder for Image-to-Image TranslationElad Richardson, Yuval Alaluf, Or Patashnik, Yotam Nitzan et al.CVPR 2021
- Closed-Form Factorization of Latent Semantics in GANsYujun Shen, Bolei ZhouCVPR 2021
- Image2StyleGAN++: How to Edit the Embedded Images?Rameen Abdal, Yipeng Qin, Peter WonkaCVPR 2020
Related papers
- SalS-GAN: Spatially-Adaptive Latent Space in StyleGAN for Real Image EmbeddingLingyun Zhang, Xiuxiu Bai, Yao GaoACM MM 2021 · 6 citations
- Designing an encoder for StyleGAN image manipulationOmer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik et al.SIGGRAPH 2021 · 692 citations
- Self-Supervised Geometry-Aware Encoder for Style-Based 3D GAN InversionYushi Lan, Xuyi Meng, Shuai Yang, Chen Change Loy et al.CVPR 2023
- From Continuity to Editability: Inverting GANs with Consecutive ImagesYangyang Xu, Yong Du, Wenpeng Xiao, Xuemiao Xu et al.ICCV 2021 · 41 citations
- ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image EditingBingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua et al.AAAI 2023 · 11 citations
