Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation
Peiye Zhuang, Oluwasanmi Koyejo, Alexander G. Schwing
Abstract
Controllable semantic image editing enables a user to change entire image attributes with few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial Net (GAN) to learn a latent space and suitable latent-space transformations. However, current approaches often suffer from attribute edits that are entangled, global image identity changes, and diminished photo-realism. To address these concerns, we learn multiple attribute transformations simultaneously, we integrate attribute regression into the training of transformation functions, apply a content loss and an adversarial loss that encourage the maintenance of image identity and photo-realism. We propose quantitative evaluation strategies for measuring controllable editing performance, unlike prior work which primarily focuses on qualitative evaluation. Our model permits better control for both single- and multiple-attribute editing, while also preserving image identity and realism during transformation. We provide empirical results for both real and synthetic images, highlighting that our model achieves state-of-the-art performance for targeted image manipulation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers23
- High-Fidelity GAN Inversion for Image Attribute EditingTengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang et al.CVPR 2022 · 227 citations
- Talk-to-Edit: Fine-Grained Facial Editing via DialogYuming Jiang, Ziqi Huang, Xingang Pan, Chen Change Loy et al.ICCV 2021 · 162 citations
- GAN-Control: Explicitly Controllable GANsAlon Shoshan, Nadav Bhonker, Igor Kviatkovsky, Gérard G. MedioniICCV 2021 · 151 citations
- StyleGAN knows Normal, Depth, Albedo, and MoreAnand Bhattad, Daniel McKee, Derek Hoiem, David A. ForsythNeurIPS 2023 · 61 citations
- Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image EditingHaonan Lin, Yan Chen, Jiahao Wang, Wenbin An et al.NeurIPS 2024 · 46 citations
Builds on9
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 459 citations
- On the "steerability" of generative adversarial networksAli Jahanian, Lucy Chai, Phillip IsolaICLR 2020 · 421 citations
- RelGAN: Multi-Domain Image-to-Image Translation via Relative AttributesYu-Jing Lin, Po-Wei Wu, Che-Han Chang, Edward Y. Chang et al.ICCV 2019 · 158 citations
- Detecting Photoshopped Faces by Scripting PhotoshopSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens et al.ICCV 2019 · 147 citations
Related papers
- SSFlow: Style-guided Neural Spline Flows for Face Image ManipulationHanbang Liang, Xianxu Hou, Linlin ShenACM MM 2021 · 11 citations
- Adaptive Nonlinear Latent Transformation for Conditional Face EditingZhizhong Huang, Siteng Ma, Junping Zhang, Hongming ShanICCV 2023 · 13 citations
- A Latent Transformer for Disentangled Face Editing in Images and VideosXu Yao, Alasdair Newson, Yann Gousseau, Pierre HellierICCV 2021 · 97 citations
- Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space ExplorationRishubh Parihar, Ankit Dhiman, Tejan Karmali, Venkatesh Babu R.ACM MM 2022 · 21 citations
- Text-Guided Unsupervised Latent Transformation for Multi-Attribute Image ManipulationXiwen Wei, Zhen Xu, Cheng Liu, Si Wu et al.CVPR 2023
