Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain Imprints
Chengdong Dong, Ajay Kumar, Eryun Liu
摘要
Accurate detection of the fake but photorealistic images is one of the most challenging tasks to address social, biometrics security and privacy related concerns in our community. Earlier research has underlined the existence of spectral domain artifacts in fake images generated by powerful generative adversarial network (GAN) based methods. Therefore, a number of highly accurate frequency domain methods to detect such GAN generated images have been proposed in the literature. Our study in this paper introduces a pipeline to mitigate the spectral artifacts. We show from our experiments that the artifacts in frequency spectrum of such fake images can be mitigated by proposed methods, which leads to the sharp decrease of performance of spectrum-based detectors. This paper also presents experimental results using a large database of images that are synthesized using BigGAN, CRN, CycleGAN, IMLE, Pro-GAN, StarGAN, StyleGAN and StyleGAN2 (including synthesized high resolution fingerprint images) to illustrate effectiveness of the proposed methods. Furthermore, we select a spatial-domain based fake image detector and observe a notable decrease in the detection performance when proposed method is incorporated. In summary, our insightful analysis and pipeline presented in this paper cautions the forensic community on the reliability of GAN-generated fake image detectors that are based on the analysis of frequency artifacts as these artifacts can be easily mitigated.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper12
- TALL: Thumbnail Layout for Deepfake Video DetectionYuting Xu, Jian Liang, Gengyun Jia, Ziming Yang 等ICCV 2023 · 被引用 133 次
- Characterizing Photorealism and Artifacts in Diffusion Model-Generated ImagesNegar Kamali, Karyn Nakamura, Aakriti Kumar, Angelos Chatzimparmpas 等CHI 2025 · 被引用 23 次
- Rethinking Mesh Watermark: Towards Highly Robust and Adaptable Deep 3D Mesh WatermarkingXingyu Zhu, Guanhui Ye, Xiapu Luo, Xuetao WeiAAAI 2024 · 被引用 14 次
- Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter ProfileSeokjun Lee, Seung-Won Jung, Hyunseok SeoAAAI 2024 · 被引用 8 次
- StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion ModelZiyin Zhou, Ke Sun, Zhongxi Chen, Huafeng Kuang 等ACM MM 2024 · 被引用 7 次
它引用的顶会 Paper10
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer 等ICML 2020 · 被引用 848 次
- Attributing Fake Images to GANs: Learning and Analyzing GAN FingerprintsNing Yu, Larry Davis, Mario FritzICCV 2019 · 被引用 533 次
- Fourier Spectrum Discrepancies in Deep Network Generated ImagesTarik Dzanic, Karan Shah, Freddie D. WitherdenNeurIPS 2020 · 被引用 235 次
- Diverse Image Synthesis From Semantic Layouts via Conditional IMLEKe Li, Tianhao Zhang, Jitendra MalikICCV 2019 · 被引用 102 次
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens 等CVPR 2020
相关 Paper
- Spectral Distribution Aware Image GenerationSteffen Jung, Margret KeuperAAAI 2021 · 被引用 42 次
- A Closer Look at Fourier Spectrum Discrepancies for CNN-Generated Images DetectionKeshigeyan Chandrasegaran, Ngoc-Trung Tran, Ngai-Man CheungCVPR 2021
- Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Domain LearningChuangchuang Tan, Yao Zhao, Shikui Wei, Guanghua Gu 等AAAI 2024 · 被引用 232 次
- FrePGAN: Robust Deepfake Detection Using Frequency-Level PerturbationsYonghyun Jeong, Doyeon Kim, Youngmin Ro, Jongwon ChoiAAAI 2022 · 被引用 159 次
- Exploring Adversarial Fake Images on Face ManifoldDongze Li, Wei Wang, Hongxing Fan, Jing DongCVPR 2021
