Rethinking the Invisible Protection against Unauthorized Image Usage in Stable Diffusion
Shengwei An, Lu Yan, Siyuan Cheng, Guangyu Shen, Kaiyuan Zhang, Qiuling Xu, Guanhong Tao, Xiangyu Zhang
摘要
Advancements in generative AI models like Stable Diffusion, DALL·E 2, and Midjourney have revolutionized digital creativity, enabling the generation of authentic-looking images from text and altering existing images with ease. Yet, their capacity poses significant ethical challenges, including replicating an artist's style without consent, the creation of counterfeit images, and potential reputational damage through manipulated content. Protection techniques have emerged to combat misuse by injecting imperceptible noises into images. This paper introduces Insight, a novel approach that challenges the robustness of these protections by aligning protected image features with human visual perception. By using a photo as a reference, approximating the human eye's perspective, Insight effectively neutralizes protective perturbations, enabling the generative model to recapture authentic features. Our extensive evaluation across 3 datasets and 10 protection techniques demonstrates its superiority over existing methods in overcoming protective measures, emphasizing the need for stronger safeguards in digital content generation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Rethinking and Red-Teaming Protective Perturbation in Personalized Diffusion ModelsYixin Liu, Ruoxi Chen, Xun Chen, Lichao SunKDD 2026 · 被引用 3 次
- LightShed: Defeating Perturbation-based Image Copyright ProtectionsHanna Foerster, Sasha Behrouzi, Phillip Rieger, Murtuza Jadliwala 等USENIX Security 2025
- CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian SamplingKaiyuan Zhang, Siyuan Cheng, Guangyu Shen, Bruno Ribeiro 等NDSS 2025
- Dormant: Defending against Pose-driven Human Image AnimationJiachen Zhou, Mingsi Wang, Tianlin Li, Guozhu Meng 等USENIX Security 2025
它引用的顶会 Paper26
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 被引用 11,724 次
相关 Paper
- IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AIBochuan Cao, Changjiang Li, Ting Wang, Jinyuan Jia 等NeurIPS 2023 · 被引用 46 次
- Adversarial Perturbations Cannot Reliably Protect Artists From Generative AIRobert Hönig, Javier Rando, Nicholas Carlini, Florian TramèrICLR 2025
- Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?Zhengyue Zhao, Jinhao Duan, Kaidi Xu, Chenan Wang 等CVPR 2024 · 被引用 12 次
- DDIM Inversion as a Perturbation Amplifier: Breaking Mimicry Protection via Reconstruction Error MinimizationHuming Qiu, Peiyi Chen, Mi Zhang, Geng Hong 等ICML 2026
- Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative EditingHanhui Wang, Yihua Zhang, Ruizheng Bai, Yue Zhao 等CVPR 2025
