DeepProtect: Proactive Face-Swapping Defense using Identity Blending and Attribute Distortion
Eungi Lee, Seung-hyeok Back, Hyung-Il Kim, Seok Bong Yoo
摘要
Face-swapping deepfakes allow realistic identity transfer, which can serve creative purposes but increases the risk of identity abuse. A proactive defense aims to prevent deepfake creation by obstructing identity feature extraction from input images, essential for identity-driven face-swapping. Existing proactive defense approaches aim to protect faces by hindering accurate identity feature extraction, but tend to introduce visible artifacts and fail to degrade the visual quality of the face-swapping deepfakes. This work proposes a proactive face-swapping defense using identity blending and attribute distortion (DeepProtect) that integrates global identity fusion in the latent space and local prompt-driven adversarial watermarking to address these problems. This work dilutes distinct identity representations by channel-wise blending of multiple identities in the latent space and optimizing the generator for visual consistency. The proposed approach distorts facial components in the identity space, directly influencing how faces are reconstructed in deepfakes. This approach applies semantic directions derived from user-provided text prompts to embed imperceptible adversarial watermarks that selectively distort facial attributes, affecting the visual fidelity of deepfake results. The proposed method hinders face-swapping deepfakes while preserving the perceptual quality of the protected images, offering a robust and practical solution for facial privacy protection. The experimental results reveal that DeepProtect effectively defends against face-swapping deepfakes while preserving visual consistency.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 被引用 1,195 次
- Diffusion Models for Adversarial PurificationWeili Nie, Brandon Guo, Yujia Huang, Chaowei Xiao 等ICML 2022 · 被引用 663 次
- SimSwap: An Efficient Framework For High Fidelity Face SwappingRenwang Chen, Xuanhong Chen, Bingbing Ni, Yanhao GeACM MM 2020 · 被引用 409 次
相关 Paper
- SCOL: Style Code Orchestration in Latent Space for Proactive Face-Swapping DefenseEungi Lee, Jae Hyun Yoon, Seok Bong YooACM MM 2025
- NullSwap: Proactive Identity Cloaking Against Deepfake Face SwappingTianyi Wang, Shuaicheng Niu, Harry Cheng, Xiao Zhang 等ICCV 2025 · 被引用 4 次
- Defeating DeepFakes via Adversarial Visual ReconstructionZiwen He, Wei Wang, Weinan Guan, Jing Dong 等ACM MM 2022 · 被引用 27 次
- DFPD: Dual-Forgery Proactive Defense against Both Deepfakes and Traditional Image ManipulationsBeijing Chen, Yuting Hong, Ziqiang Li, Zhangjie FuACM MM 2025
- FaceShield: Defending Facial Image Against Deepfake ThreatsJaehwan Jeong, Sumin In, Sieun Kim, Hannie Shin 等ICCV 2025 · 被引用 3 次
