T-GD: Transferable GAN-generated Images Detection Framework
Hyeonseong Jeon, Youngoh Bang, Junyaup Kim, Simon S. Woo
Abstract
Recent advancements in Generative Adversarial Networks (GANs) enable the generation of highly realistic images, raising concerns about their misuse for malicious purposes. Detecting these GAN-generated images (GAN-images) becomes increasingly challenging due to the significant reduction of underlying artifacts and specific patterns. The absence of such traces can hinder detection algorithms from identifying GAN-images and transferring knowledge to identify other types of GAN-images as well. In this work, we present the Transferable GAN-images Detection framework T-GD, a robust transferable framework for an effective detection of GAN-images. T-GD is composed of a teacher and a student model that can iteratively teach and evaluate each other to improve the detection performance. First, we train the teacher model on the source dataset and use it as a starting point for learning the target dataset. To train the student model, we inject noise by mixing up the source and target datasets, while constraining the weight variation to preserve the starting point. Our approach is a self-training method, but distinguishes itself from prior approaches by focusing on improving the transferability of GAN-image detection. T-GD achieves high performance on the source dataset by overcoming catastrophic forgetting and effectively detecting state-of-the-art GAN-images with only a small volume of data without any metadata information.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6900f0ad-2cad-415b-9ddf-18a822eb39b2Cited by top-tier papers5
- ADD: Frequency Attention and Multi-View Based Knowledge Distillation to Detect Low-Quality Compressed Deepfake ImagesLe Minh Binh, Simon S. WooAAAI 2022 · 114 citations
- One Detector to Rule Them All: Towards a General Deepfake Attack Detection FrameworkShahroz Tariq, Sangyup Lee, Simon S. WooWWW 2021 · 90 citations
- Deepfake Network Architecture AttributionTianyun Yang, Ziyao Huang, Juan Cao, Lei Li et al.AAAI 2022 · 72 citations
- Quality-Agnostic Deepfake Detection with Intra-model Collaborative LearningBinh Minh Le, Simon S. WooICCV 2023 · 50 citations
- CoReD: Generalizing Fake Media Detection with Continual Representation using DistillationMinha Kim, Shahroz Tariq, Simon S. WooACM MM 2021 · 48 citations
Builds on8
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- SinGAN: Learning a Generative Model From a Single Natural ImageTamar Rott Shaham, Tali Dekel, Tomer MichaeliICCV 2019 · 933 citations
- Few-Shot Adversarial Learning of Realistic Neural Talking Head ModelsEgor Zakharov, Aliaksandra Shysheya, Egor Burkov, Victor S. LempitskyICCV 2019 · 687 citations
- Attributing Fake Images to GANs: Learning and Analyzing GAN FingerprintsNing Yu, Larry Davis, Mario FritzICCV 2019 · 533 citations
- Rethinking the Hyperparameters for Fine-tuningHao Li, Pratik Chaudhari, Hao Yang, Michael Lam et al.ICLR 2020 · 142 citations
Related papers
- Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images DetectionChuangchuang Tan, Yao Zhao, Shikui Wei, Guanghua Gu et al.CVPR 2023
- FrePGAN: Robust Deepfake Detection Using Frequency-Level PerturbationsYonghyun Jeong, Doyeon Kim, Youngmin Ro, Jongwon ChoiAAAI 2022 · 159 citations
- Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training DataNing Yu, Vladislav Skripniuk, Sahar Abdelnabi, Mario FritzICCV 2021 · 305 citations
- Lifelong GAN: Continual Learning for Conditional Image GenerationMengyao Zhai, Lei Chen, Frederick Tung, Jiawei He et al.ICCV 2019 · 204 citations
- On Leveraging Pretrained GANs for Generation with Limited DataMiaoyun Zhao, Yulai Cong, Lawrence CarinICML 2020 · 102 citations
