SPDMark: Selective Parameter Displacement for Robust Video Watermarking
Samar Fares, Nurbek Tastan, Karthik Nandakumar
Abstract
The advent of high-quality video generation models has amplified the need for robust watermarking schemes that can be used to reliably detect and track the provenance of generated videos. Existing video watermarking methods based on both post-hoc and in-generation approaches fail to simultaneously achieve imperceptibility, robustness, and computational efficiency. This work introduces a novel framework for in-generation video watermarking called SPDMark (pronounced SpeedMark') based on **selective parameter displacement** of a video diffusion model. Watermarks are embedded into the generated videos by modifying a subset of parameters in the generative model. To make the problem tractable, the displacement is modeled as an additive composition of layer-wise basis shifts, where the final composition is indexed by the watermarking key. For parameter efficiency, this work specifically leverages low-rank adaptation (LoRA) to implement the basis shifts. During the training phase, the basis shifts and the watermark extractor are jointly learned by minimizing a combination of message recovery, perceptual similarity, and temporal consistency losses. To detect and localize temporal modifications in the watermarked videos, we use a cryptographic hashing function to derive frame-specific watermark messages from the given base watermarking key. During watermark extraction, maximum bipartite matching is applied to recover the correct frame order, even from temporally tampered videos. Evaluations on both text-to-video and image-to-video generation models demonstrate the ability of **SPDMark`** to generate imperceptible watermarks that can be recovered with high accuracy and also establish its robustness against a variety of common video modifications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Related papers
- SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video DiffusionXinjie zhu, Zijing Zhao, Hui Jin, Qingxiao Guo et al.ICLR 2026 · 1 citation
- MOLM: Mixture of LoRA MarkersSamar Fares, Nurbek Tastan, Noor Hazim Hussein, Karthik NandakumarICLR 2026
- VideoShield: Regulating Diffusion-based Video Generation Models via WatermarkingRunyi Hu, Jie Zhang, Yiming Li, Jiwei Li et al.ICLR 2025
- OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time OptimizationJiazheng Xing, Hai Ci, Hongbin Xu, Hangjie Yuan et al.AAAI 2026 · 2 citations
- A Novel Deep Video Watermarking Framework with Enhanced Robustness to H.264/AVC CompressionYulin Zhang, Jiangqun Ni, Wenkang Su, Xin LiaoACM MM 2023 · 25 citations
