MOLM: Mixture of LoRA Markers
Samar Fares, Nurbek Tastan, Noor Hazim Hussein, Karthik Nandakumar
摘要
Generative models can generate photorealistic images at scale. This raises serious concerns about the ability to detect synthetically generated images and attribute these images to specific sources. While watermarking has emerged as a possible solution, existing methods remain fragile to realistic distortions, susceptible to adaptive removal, and expensive to update when the underlying watermarking key changes. We propose a general watermarking framework that formulates the encoding problem as key-dependent perturbation of the parameters of a generative model. Within this framework, we introduce Mixture of LoRA Markers (MOLM), a routing-based instantiation in which binary keys activate lightweight low-rank adapters (LoRA) inside residual and attention blocks. This design avoids key-specific re-training and achieves the desired properties such as imperceptibility, fidelity, verifiability, and robustness. Experiments on Stable Diffusion and FLUX show that MOLM preserves image quality while achieving robust key recovery against distortions, compression and regeneration, averaging attacks, and black-box adversarial attacks on the extractor. Code is available at https://github.com/Samar-Fares/MOLM-Watermark
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Pseudo Numerical Methods for Diffusion Models on ManifoldsLuping Liu, Yi Ren, Zhijie Lin, Zhou ZhaoICLR 2022 · 被引用 861 次
相关 Paper
- SPDMark: Selective Parameter Displacement for Robust Video WatermarkingSamar Fares, Nurbek Tastan, Karthik NandakumarCVPR 2026 · 被引用 2 次
- MSAT-LDM: Toward Transferable High-Fidelity Watermarking for Latent Diffusion Model via Modular Self-Augmented TrainingLu Zhang, Liang ZengAAAI 2026
- ROAR: Reducing Inversion Error in Generative Image WatermarkingHanyi Wang, Han Fang, Shi-Lin Wang, Ee-Chien ChangICCV 2025 · 被引用 1 次
- SEAL: Semantic Aware Image WatermarkingKasra Arabi, R. Teal Witter, Chinmay Hegde, Niv CohenICCV 2025 · 被引用 22 次
- GenPTW: Latent Image Watermarking for Provenance Tracing and Tamper LocalizationZhenliang Gan, Chunya Liu, Yichao Tang, Binghao Wang 等AAAI 2026 · 被引用 3 次
