A Closer Look at Fourier Spectrum Discrepancies for CNN-Generated Images Detection
Keshigeyan Chandrasegaran, Ngoc-Trung Tran, Ngai-Man Cheung
摘要
CNN-based generative modelling has evolved to produce synthetic images indistinguishable from real images in the RGB pixel space. Recent works have observed that CNNgenerated images share a systematic shortcoming in replicating high frequency Fourier spectrum decay attributes. Furthermore, these works have successfully exploited this systematic shortcoming to detect CNN-generated images reporting up to 99% accuracy across multiple state-of-theart GAN models. In this work, we investigate the validity of assertions claiming that CNN-generated images are unable to achieve high frequency spectral decay consistency. We meticulously construct a counterexample space of high frequency spectral decay consistent CNN-generated images emerging from our handcrafted experiments using DCGAN, LSGAN, WGAN-GP and StarGAN, where we empirically show that this frequency discrepancy can be avoided by a minor architecture change in the last upsampling operation. We subsequently use images from this counterexample space to successfully bypass the recently proposed forensics detector which leverages on high frequency Fourier spectrum decay attributes for CNN-generated image detection. Through this study, we show that high frequency Fourier spectrum decay discrepancies are not inherent characteristics for existing CNN-based generative models-contrary to the belief of some existing work-, and such features are not robust to perform synthetic image detection. Our results prompt re-thinking of using high frequency Fourier spectrum decay attributes for CNNgenerated image detection. Code and models are available at https://keshik6.github.io/Fourier- Discrepancies-CNN-Detection/
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper24
- On the Frequency Bias of Generative ModelsKatja Schwarz, Yiyi Liao, Andreas GeigerNeurIPS 2021 · 被引用 117 次
- OST: Improving Generalization of DeepFake Detection via One-Shot Test-Time TrainingLiang Chen, Yong Zhang, Yibing Song, Jue Wang 等NeurIPS 2022 · 被引用 102 次
- Will Large-scale Generative Models Corrupt Future Datasets?Ryuichiro Hataya, Han Bao, Hiromi AraiICCV 2023 · 被引用 76 次
- Deepfake Network Architecture AttributionTianyun Yang, Ziyao Huang, Juan Cao, Lei Li 等AAAI 2022 · 被引用 72 次
- A Closer Look at Few-shot Image GenerationYunqing Zhao, Henghui Ding, Houjing Huang, Ngai-Man CheungCVPR 2022 · 被引用 71 次
它引用的顶会 Paper10
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine 等NeurIPS 2020 · 被引用 2,345 次
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer 等ICML 2020 · 被引用 848 次
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu 等NeurIPS 2020 · 被引用 707 次
- Fourier Spectrum Discrepancies in Deep Network Generated ImagesTarik Dzanic, Karan Shah, Freddie D. WitherdenNeurIPS 2020 · 被引用 235 次
- Diverse Image Synthesis From Semantic Layouts via Conditional IMLEKe Li, Tianhao Zhang, Jitendra MalikICCV 2019 · 被引用 102 次
相关 Paper
- Watch Your Up-Convolution: CNN Based Generative Deep Neural Networks Are Failing to Reproduce Spectral DistributionsRicard Durall, Margret Keuper, Janis KeuperCVPR 2020
- Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain ImprintsChengdong Dong, Ajay Kumar, Eryun LiuCVPR 2022 · 被引用 61 次
- Spectral Distribution Aware Image GenerationSteffen Jung, Margret KeuperAAAI 2021 · 被引用 42 次
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens 等CVPR 2020
- Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter ProfileSeokjun Lee, Seung-Won Jung, Hyunseok SeoAAAI 2024 · 被引用 8 次
