QC-StyleGAN - Quality Controllable Image Generation and Manipulation
Dat Viet Thanh Nguyen, Phong Tran The, Tan M. Dinh, Cuong Pham, Anh Tran
Abstract
The introduction of high-quality image generation models, particularly the Style-GAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation. The code is available at https://github.com/VinAIResearch/QC-StyleGAN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f9218a93-4fa3-416b-b94c-eaff75f9eaeeBuilds on28
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- StyleCLIP: Text-Driven Manipulation of StyleGAN ImageryOr Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or et al.ICCV 2021 · 1,437 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
Related papers
- High-Resolution GAN Inversion for Degraded Images in Large Diverse DatasetsYanbo Wang, Chuming Lin, Donghao Luo, Ying Tai et al.AAAI 2023 · 9 citations
- Robust Unsupervised StyleGAN Image RestorationYohan Poirier-Ginter, Jean-François LalondeCVPR 2023
- StyleRes: Transforming the Residuals for Real Image Editing with StyleGANHamza Pehlivan, Yusuf Dalva, Aysegul DundarCVPR 2023
- ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image EditingBingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua et al.AAAI 2023 · 11 citations
- Diverse Inpainting and Editing with GAN InversionAhmet Burak Yildirim, Hamza Pehlivan, Bahri Batuhan Bilecen, Aysegul DundarICCV 2023 · 35 citations
