SafePaint: Anti-forensic Image Inpainting with Domain Adaptation
Dunyun Chen, Xin Liao, Xiaoshuai Wu, Shiwei Chen
Abstract
Existing image inpainting methods have achieved remarkable accomplishments in generating visually appealing results, often accompanied by a trend toward creating more intricate structural textures. However, while these models excel at creating more realistic image content, they often leave noticeable traces of tampering, posing a significant threat to security. In this work, we take the anti-forensic capabilities into consideration, firstly proposing an end-to-end training framework for anti-forensic image inpainting named SafePaint. Specifically, we innovatively formulated image inpainting as two major tasks: semantically plausible content completion and region-wise optimization. The former is similar to current inpainting methods that aim to restore the missing regions of corrupted images. The latter, through domain adaptation, endeavors to reconcile the discrepancies between the inpainted region and the unaltered area to achieve anti-forensic goals. Through comprehensive theoretical analysis, we validate the effectiveness of domain adaptation for anti-forensic performance. Furthermore, we meticulously crafted a region-wise separated attention (RWSA) module, which not only aligns with our objective of anti-forensics but also enhances the performance of the model. Extensive qualitative and quantitative evaluations show our approach achieves comparable results to existing image inpainting methods while offering anti-forensic capabilities not available in other methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen et al.ICCV 2019 · 1,990 citations
- RePaint: Inpainting using Denoising Diffusion Probabilistic ModelsAndreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu et al.CVPR 2022 · 1,425 citations
- Coherent Semantic Attention for Image InpaintingHongyu Liu, Bin Jiang, Yi Xiao, Chao YangICCV 2019 · 395 citations
- Image Inpainting via Conditional Texture and Structure Dual GenerationXiefan Guo, Hongyu Yang, Di HuangICCV 2021 · 283 citations
- Localization of Deep Inpainting Using High-Pass Fully Convolutional NetworkHaodong Li, Jiwu HuangICCV 2019 · 157 citations
Related papers
- AdvPaint: Protecting Images from Inpainting Manipulation via Adversarial Attention DisruptionJoonsung Jeon, Woo Jae Kim, Suhyeon Ha, Sooel Son et al.ICLR 2025
- SAFIRE: Segment Any Forged Image RegionMyung-Joon Kwon, Wonjun Lee, Seung-Hun Nam, Minji Son et al.AAAI 2025 · 25 citations
- Semi-Supervised Video Inpainting with Cycle Consistency ConstraintsZhiliang Wu, Hanyu Xuan, Changchang Sun, Weili Guan et al.CVPR 2023
- Image Inpainting Guided by Coherence Priors of Semantics and TexturesLiang Liao, Jing Xiao, Zheng Wang, Chia-Wen Lin et al.CVPR 2021
- Text-Guided Neural Image InpaintingLisai Zhang, Qingcai Chen, Baotian Hu, Shuoran JiangACM MM 2020 · 53 citations
