Spectral Distribution Aware Image Generation
Steffen Jung, Margret Keuper
Abstract
Recent advances in deep generative models for photo-realistic images have led to high quality visual results. Such models learn to generate data from a given training distribution such that generated images can not be easily distinguished from real images by the human eye. Yet, recent work on the detection of such fake images pointed out that they are actually easily distinguishable by artifacts in their frequency spectra. In this paper, we propose to generate images according to the frequency distribution of the real data by employing a spectral discriminator. The proposed discriminator is lightweight, modular and works stably with different commonly used GAN losses. We show that the resulting models can better generate images with realistic frequency spectra, which are thus harder to detect by this cue.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3c7bb99f-e3c6-41c9-93aa-4d782c211dbfCited by top-tier papers10
- Focal Frequency Loss for Image Reconstruction and SynthesisLiming Jiang, Bo Dai, Wayne Wu, Chen Change LoyICCV 2021 · 422 citations
- On the Frequency Bias of Generative ModelsKatja Schwarz, Yiyi Liao, Andreas GeigerNeurIPS 2021 · 117 citations
- FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance TrackingRun Wang, Felix Juefei-Xu, Meng Luo, Yang Liu et al.ACM MM 2021 · 77 citations
- CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasksShashank Agnihotri, Steffen Jung, Margret KeuperICML 2024 · 35 citations
- When Semantic Segmentation Meets Frequency AliasingLinwei Chen, Lin Gu, Ying FuICLR 2024 · 30 citations
Builds on5
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer et al.ICML 2020 · 848 citations
- Attributing Fake Images to GANs: Learning and Analyzing GAN FingerprintsNing Yu, Larry Davis, Mario FritzICCV 2019 · 533 citations
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens et al.CVPR 2020
- Watch Your Up-Convolution: CNN Based Generative Deep Neural Networks Are Failing to Reproduce Spectral DistributionsRicard Durall, Margret Keuper, Janis KeuperCVPR 2020
- Analyzing and Improving the Image Quality of StyleGANTero Karras, Samuli Laine, Miika Aittala, Janne Hellsten et al.CVPR 2020
Related papers
- Fourier Spectrum Discrepancies in Deep Network Generated ImagesTarik Dzanic, Karan Shah, Freddie D. WitherdenNeurIPS 2020 · 235 citations
- SSD-GAN: Measuring the Realness in the Spatial and Spectral DomainsYuanqi Chen, Ge Li, Cece Jin, Shan Liu et al.AAAI 2021 · 61 citations
- Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter ProfileSeokjun Lee, Seung-Won Jung, Hyunseok SeoAAAI 2024 · 8 citations
- Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain ImprintsChengdong Dong, Ajay Kumar, Eryun LiuCVPR 2022 · 61 citations
- A Closer Look at Fourier Spectrum Discrepancies for CNN-Generated Images DetectionKeshigeyan Chandrasegaran, Ngoc-Trung Tran, Ngai-Man CheungCVPR 2021
