Who Controls the Authorization? Invertible Networks for Copyright Protection in Text-to-Image Synthesis
Baoyue Hu, Yang Wei, Junhao Xiao, Wendong Huang, Xiuli Bi, Bin Xiao
摘要
To defend against personalized generation, a new form of infringement that is more concealed and destructive, the existing copyright protection methods is to add adversarial perturbations in images. However, these methods focus solely on countering illegal personalization, neglecting the requirement for legitimate personalization. Moreover, none of these methods are capable of directly verifying and tracing the copyright from adversarial examples. In response to these limitations, we propose a traceable and authorizable copyright traceability method that embeds the copyright watermark into images through a series of invertible compound coupling modules. We introduce a novel information exchange mechanism for invertible neural network and design a contrastive learning-based optimization strategy tailored to address personalized infringement issues. Our method effectively mitigates the malicious use of unauthorized personalized generation models by inducing watermark-like artifacts and obscuring privacy details in generated images. Additionally, it facilitates copyright traceability and supports authorized legitimate personalization, thereby offering broader practical applicability. Experimental results demonstrate that our method can almost losslessly restore original image and extract copyright watermark, achieving FID exceeding 300 and causing visually noticeable artifacts in unauthorized personalized images. Furthermore, it exhibits consistent robustness against adversarial purification and text prompt modifications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual InversionRinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik 等ICLR 2023 · 被引用 464 次
- HiNet: Deep Image Hiding by Invertible NetworkJunpeng Jing, Xin Deng, Mai Xu, Jianyi Wang 等ICCV 2021 · 被引用 301 次
相关 Paper
- Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion ModelsPeifei Zhu, Tsubasa Takahashi, Hirokatsu KataokaCVPR 2024 · 被引用 14 次
- Disentangled Style Domain for Implicit z-Watermark Towards Copyright ProtectionJunqiang Huang, Zhaojun Guo, Ge Luo, Zhenxing Qian 等NeurIPS 2024 · 被引用 5 次
- IRWArt: Levering Watermarking Performance for Protecting High-quality Artwork ImagesYuanjing Luo, Tongqing Zhou, Fang Liu, Zhiping CaiWWW 2023 · 被引用 26 次
- Robust Secure Swap: Responsible Face Swap With Persons of Interest Redaction and Provenance TraceabilityYunshu Dai, Jianwei Fei, Fangjun Huang, Chip Hong ChangICML 2025
- Countering Personalized Text-to-Image Generation with Influence WatermarksHanwen Liu, Zhicheng Sun, Yadong MuCVPR 2024
