Pseudorandom Error-Correcting Codes
Miranda Christ, Sam Gunn
Abstract
We construct pseudorandom error-correcting codes (or simply pseudorandom codes), which are errorcorrecting codes with the property that any polynomial number of codewords are pseudorandom to any computationally-bounded adversary. Efficient decoding of corrupted codewords is possible with the help of a decoding key.
We build pseudorandom codes that are robust to substitution and deletion errors, where pseudorandomness rests on standard cryptographic assumptions. Specifically, pseudorandomness is based on either 2 O( √ n) -hardness of LPN, or polynomial hardness of LPN and the planted XOR problem at low density. As our primary application of pseudorandom codes, we present an undetectable watermarking scheme for outputs of language models that is robust to cropping and a constant rate of random substitutions and deletions. The watermark is undetectable in the sense that any number of samples of watermarked text are computationally indistinguishable from text output by the original model. This is the first undetectable watermarking scheme that can tolerate a constant rate of errors.
Our second application is to steganography, where a secret message is hidden in innocent-looking content. We present a constant-rate stateless steganography scheme with robustness to a constant rate of substitutions. Ours is the first stateless steganography scheme with provable steganographic security and any robustness to errors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 923619d1-69b4-4d4d-946b-bbf83db87f63Cited by top-tier papers23
- Edit Distance Robust Watermarks via Indexing Pseudorandom CodesNoah Golowich, Ankur MoitraNeurIPS 2024 · 24 citations
- PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel ConstraintsJiahao Huo, Shuliang Liu, Bin Wang, Junyan Zhang et al.ICLR 2026 · 18 citations
- T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion ModelsJindong Yang, Han Fang, Weiming Zhang, Nenghai Yu et al.NeurIPS 2025 · 13 citations
- Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language ModelsAlkis Kalavasis, Amin Karbasi, Argyris Oikonomou, Katerina Sotiraki et al.NeurIPS 2024 · 5 citations
- Improved Pseudorandom Codes from Permuted PuzzlesMiranda Christ, Noah Golowich, Sam Gunn, Ankur Moitra et al.STOC 2026 · 5 citations
Builds on7
- DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability CurvatureEric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning et al.ICML 2023 · 988 citations
- A Watermark for Large Language ModelsJohn Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz et al.ICML 2023 · 854 citations
- Efficient Batched Oblivious PRF with Applications to Private Set IntersectionVladimir Kolesnikov, Ranjit Kumaresan, Mike Rosulek, Ni TrieuCCS 2016 · 429 citations
- Provable Robust Watermarking for AI-Generated TextXuandong Zhao, Prabhanjan Vijendra Ananth, Lei Li, Yu-Xiang WangICLR 2024 · 312 citations
- On the Reliability of Watermarks for Large Language ModelsJohn Kirchenbauer, Jonas Geiping, Yuxin Wen, Manli Shu et al.ICLR 2024 · 202 citations
Related papers
- Chosen Ciphertext Secure Pseudorandom Codes in the Standard ModelNico Döttling, Antoine Joux, Venkata Koppula, Mahesh Sreekumar Rajasree et al.CRYPTO 2026
- Ideal Pseudorandom CodesOmar Alrabiah, Prabhanjan Ananth, Miranda Christ, Yevgeniy Dodis et al.STOC 2025 · 2 citations
- An Undetectable Watermark for Generative Image ModelsSam Gunn, Xuandong Zhao, Dawn SongICLR 2025
- Cryptanalysis of LDPC-Based Pseudorandom Error-Correcting CodesTianrui Wang, Anyu Wang, Tianshuo Cong, Delong Ran et al.USENIX Security 2026 · 1 citation
- Unforgeable Watermarks for Language Models via Robust SignaturesHuijia Lin, Kameron Shahabi, Min Jae SongCRYPTO 2026
