Responsible Disclosure of Generative Models Using Scalable Fingerprinting
Ning Yu, Vladislav Skripniuk, Dingfan Chen, Larry S. Davis, Mario Fritz
Abstract
Over the past five years, deep generative models have achieved a qualitative new level of performance. Generated data has become difficult, if not impossible, to be distinguished from real data. While there are plenty of use cases that benefit from this technology, there are also strong concerns on how this new technology can be misused to spoof sensors, generate deep fakes, and enable misinformation at scale. Unfortunately, current deep fake detection methods are not sustainable, as the gap between real and fake continues to close. In contrast, our work enables a responsible disclosure of such state-of-the-art generative models, that allows researchers and companies to fingerprint their models, so that the generated samples containing a fingerprint can be accurately detected and attributed to a source. Our technique achieves this by an efficient and scalable ad-hoc generation of a large population of models with distinct fingerprints. Our recommended operation point uses a 128-bit fingerprint which in principle results in more than identifiable models. Experimental results show that our method fulfills key properties of a fingerprinting mechanism and achieves effectiveness in deep fake detection and attribution.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 326498a1-a348-4b8d-99db-70d68ce6f89fCited by top-tier papers35
- The Stable Signature: Rooting Watermarks in Latent Diffusion ModelsPierre Fernandez, Guillaume Couairon, Hervé Jégou, Matthijs Douze et al.ICCV 2023 · 370 citations
- Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training DataNing Yu, Vladislav Skripniuk, Sahar Abdelnabi, Mario FritzICCV 2021 · 305 citations
- Proactive Detection of Voice Cloning with Localized WatermarkingRobin San Roman, Pierre Fernandez, Hady Elsahar, Alexandre Défossez et al.ICML 2024 · 119 citations
- Real-Time Radiance Fields for Single-Image Portrait View SynthesisAlex Trevithick, Matthew A. Chan, Michael Stengel, Eric R. Chan et al.SIGGRAPH 2023 · 69 citations
- Leveraging Optimization for Adaptive Attacks on Image WatermarksNils Lukas, Abdulrahman Diaa, Lucas Fenaux, Florian KerschbaumICLR 2024 · 50 citations
Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer et al.ICML 2020 · 848 citations
- Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by BackdooringYossi Adi, Carsten Baum, Moustapha Cissé, Benny Pinkas et al.USENIX Security 2018 · 832 citations
- Attributing Fake Images to GANs: Learning and Analyzing GAN FingerprintsNing Yu, Larry Davis, Mario FritzICCV 2019 · 533 citations
- Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training DataNing Yu, Vladislav Skripniuk, Sahar Abdelnabi, Mario FritzICCV 2021 · 305 citations
Related papers
- WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion ModelsChanghoon Kim, Kyle Min, Maitreya Patel, Sheng Cheng et al.CVPR 2024
- Attributing Image Generative Models using Latent FingerprintsGuangyu Nie, Changhoon Kim, Yezhou Yang, Yi RenICML 2023 · 23 citations
- DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation ModelsZeyang Sha, Zheng Li, Ning Yu, Yang ZhangCCS 2023 · 123 citations
- ZeroFake: Zero-Shot Detection of Fake Images Generated and Edited by Text-to-Image Generation ModelsZeyang Sha, Yicong Tan, Mingjie Li, Michael Backes et al.CCS 2024 · 8 citations
- ManiFPT: Defining and Analyzing Fingerprints of Generative ModelsHae Jin Song, Mahyar Khayatkhoei, Wael AbdAlmageedCVPR 2024 · 5 citations
