LORD-GoF: A Robust Online Detection Approach for LLM Watermarks in Sparse and Mixed Streams
Jiade Xu, Zhouping Li
摘要
Watermarking is crucial for identifying AIgenerated text; however, existing detection methods often focus on offline settings and fail to control the online False Discovery Rate (oFDR) when applied to real-world streams where machinegenerated content is sparse and mixed with human writing. To address this issue, in this paper, we propose LORD-GOF, a novel online detection framework that combines a Goodness-of-Fit (GoF) statistic with the Levels based On Recent Discovery (LORD) procedure. We prove that the LORD-GOF approach can rigorously control the oFDR below a user-specified level by dynamically adjusting detection thresholds. Extensive experiments on watermarked text from Qwen-2.5-3B, Sheared-LLaMA-2.7B, and OPT-1.3B using both the Gumbel-Max and Inverse Transform watermarking schemes show that our method maintains statistical power comparable to offline benchmarks while successfully controlling the oFDR under complex, mixed streaming scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- A Watermark for Large Language ModelsJohn Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz 等ICML 2023 · 被引用 854 次
- Watermark Stealing in Large Language ModelsNikola Jovanovic, Robin Staab, Martin T. VechevICML 2024 · 被引用 88 次
- Adaptive Text Watermark for Large Language ModelsYepeng Liu, Yuheng BuICML 2024 · 被引用 63 次
- Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language ModelsMingjia Huo, Sai Ashish Somayajula, Youwei Liang, Ruisi Zhang 等ICML 2024 · 被引用 37 次
- On the Empirical Power of Goodness-of-Fit Tests in Watermark DetectionWeiqing He, Xiang Li, Tianqi Shang, Li Shen 等NeurIPS 2025 · 被引用 6 次
相关 Paper
- Efficiently Identifying Watermarked Segments in Mixed-Source TextsXuandong Zhao, Chenwen Liao, Yuxiang Wang, Lei LiACL 2025 · 被引用 3 次
- On the Reliability of Watermarks for Large Language ModelsJohn Kirchenbauer, Jonas Geiping, Yuxin Wen, Manli Shu 等ICLR 2024 · 被引用 202 次
- Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by BettingCan Chen, Jun-Kun WangICML 2025
- How Good is Post-Hoc Watermarking With Language Model Rephrasing?Pierre Fernandez, Tom Sander, Hady Elsahar, Hongyan Chang 等ICML 2026 · 被引用 2 次
- GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trickJiayi Fu, Xuandong Zhao, Ruihan Yang, Yuansen Zhang 等ACL 2024 · 被引用 6 次
