Proactive Image Manipulation Detection
Vishal Asnani, Xi Yin, Tal Hassner, Sijia Liu, Xiaoming Liu
摘要
Image manipulation detection algorithms are often trained to discriminate between images manipulated with particular Generative Models (GMs) and genuine/real images, yet generalize poorly to images manipulated with GMs unseen in the training. Conventional detection algorithms receive an input image passively. By contrast, we propose a proactive scheme to image manipulation detection. Our key enabling technique is to estimate a set of templates which when added onto the real image would lead to more accurate manipulation detection. That is, a template protected real image, and its manipulated version, is better discriminated compared to the original real image vs. its manipulated one. These templates are estimated using certain constraints based on the desired properties of templates. For image manipulation detection, our proposed approach outperforms the prior work by an average precision of 16% for CycleGAN and 32% for GauGAN. Our approach is generalizable to a variety of GMs showing an improvement over prior work by an average precision of 10% averaged across 12 GMs. Our code is available at https:// www.github.com/vishal3477/proactive_IMD .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper19
- SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake DetectionXiaoshuai Wu, Xin Liao, Bo OuACM MM 2023 · 被引用 74 次
- Tame a Wild Camera: In-the-Wild Monocular Camera CalibrationShengjie Zhu, Abhinav Kumar, Masa Hu, Xiaoming LiuNeurIPS 2023 · 被引用 47 次
- RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching DetectionQichao Ying, Jiaxin Liu, Sheng Li, Haisheng Xu 等ACM MM 2023 · 被引用 13 次
- DRAW: Defending Camera-shooted RAW against Image ManipulationXiaoxiao Hu, Qichao Ying, Zhenxing Qian, Sheng Li 等ICCV 2023 · 被引用 12 次
- PrObeD: Proactive Object Detection WrapperVishal Asnani, Abhinav Kumar, Suya You, Xiaoming LiuNeurIPS 2023 · 被引用 11 次
它引用的顶会 Paper10
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess 等ICCV 2019 · 被引用 2,966 次
- FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance TrackingRun Wang, Felix Juefei-Xu, Meng Luo, Yang Liu 等ACM MM 2021 · 被引用 77 次
- MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image ManipulationSafa C. Medin, Bernhard Egger, Anoop Cherian, Ye Wang 等AAAI 2022 · 被引用 38 次
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens 等CVPR 2020
- SEAN: Image Synthesis With Semantic Region-Adaptive NormalizationPeihao Zhu, Rameen Abdal, Yipeng Qin, Peter WonkaCVPR 2020
相关 Paper
- MaLP: Manipulation Localization Using a Proactive SchemeVishal Asnani, Xi Yin, Tal Hassner, Xiaoming LiuCVPR 2023
- FrePGAN: Robust Deepfake Detection Using Frequency-Level PerturbationsYonghyun Jeong, Doyeon Kim, Youngmin Ro, Jongwon ChoiAAAI 2022 · 被引用 159 次
- T-GD: Transferable GAN-generated Images Detection FrameworkHyeonseong Jeon, Youngoh Bang, Junyaup Kim, Simon S. WooICML 2020 · 被引用 57 次
- Frequency-aware GAN for Adversarial Manipulation GenerationPeifei Zhu, Genki Osada, Hirokatsu Kataoka, Tsubasa TakahashiICCV 2023 · 被引用 13 次
- Defeating DeepFakes via Adversarial Visual ReconstructionZiwen He, Wei Wang, Weinan Guan, Jing Dong 等ACM MM 2022 · 被引用 27 次
