Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Ning Yu, Larry Davis, Mario Fritz
摘要
Recent advances in Generative Adversarial Networks (GANs) have shown increasing success in generating photorealistic images. But they also raise challenges to visual forensics and model attribution. We present the first study of learning GAN fingerprints towards image attribution and using them to classify an image as real or GANgenerated. For GAN-generated images, we further identify their sources. Our experiments show that (1) GANs carry distinct model fingerprints and leave stable fingerprints in their generated images, which support image attribution; (2) even minor differences in GAN training can result in different fingerprints, which enables fine-grained model authentication; (3) fingerprints persist across different image frequencies and patches and are not biased by GAN artifacts; (4) fingerprint finetuning is effective in immunizing against five types of adversarial image perturbations; and (5) comparisons also show our learned fingerprints consistently outperform several baselines in a variety of setups 1 .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper84
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer 等ICML 2020 · 被引用 848 次
- DIRE for Diffusion-Generated Image DetectionZhendong Wang, Jianmin Bao, Wengang Zhou, Weilun Wang 等ICCV 2023 · 被引用 479 次
- The Stable Signature: Rooting Watermarks in Latent Diffusion ModelsPierre Fernandez, Guillaume Couairon, Hervé Jégou, Matthijs Douze 等ICCV 2023 · 被引用 370 次
- Zero-shot Image-to-Image TranslationGaurav Parmar, Krishna Kumar Singh, Richard Zhang, Yijun Li 等SIGGRAPH 2023 · 被引用 355 次
- Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training DataNing Yu, Vladislav Skripniuk, Sahar Abdelnabi, Mario FritzICCV 2021 · 被引用 305 次
它引用的顶会 Paper1
相关 Paper
- Deepfake Network Architecture AttributionTianyun Yang, Ziyao Huang, Juan Cao, Lei Li 等AAAI 2022 · 被引用 72 次
- Towards Discovery and Attribution of Open-world GAN Generated ImagesSharath Girish, Saksham Suri, Sai Saketh Rambhatla, Abhinav ShrivastavaICCV 2021 · 被引用 87 次
- ManiFPT: Defining and Analyzing Fingerprints of Generative ModelsHae Jin Song, Mahyar Khayatkhoei, Wael AbdAlmageedCVPR 2024 · 被引用 5 次
- Attributing Image Generative Models using Latent FingerprintsGuangyu Nie, Changhoon Kim, Yezhou Yang, Yi RenICML 2023 · 被引用 23 次
- WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion ModelsChanghoon Kim, Kyle Min, Maitreya Patel, Sheng Cheng 等CVPR 2024
