Denoising Diffusion Error Correction Codes
Yoni Choukroun, Lior Wolf
Abstract
Error correction code (ECC) is an integral part of the physical communication layer, ensuring reliable data transfer over noisy channels. Recently, neural decoders have demonstrated their advantage over classical decoding techniques. However, recent state-of-the-art neural decoders suffer from high complexity and lack the important iterative scheme characteristic of many legacy decoders. In this work, we propose to employ denoising diffusion models for the soft decoding of linear codes at arbitrary block lengths. Our framework models the forward channel corruption as a series of diffusion steps that can be reversed iteratively. Three contributions are made: (i) a diffusion process suitable for the decoding setting is introduced, (ii) the neural diffusion decoder is conditioned on the number of parity errors, which indicates the level of corruption at a given step, (iii) a line search procedure based on the code's syndrome obtains the optimal reverse diffusion step size. The proposed approach demonstrates the power of diffusion models for ECC and is able to achieve state of the art accuracy, outperforming the other neural decoders by sizable margins, even for a single reverse diffusion step.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 66242753-3278-43f5-bcff-98c62643529dCited by top-tier papers10
- Efficient Message-Passing Transformer for Error Correcting CodesSeong-Joon Park, Taewoo Park, Hee-Youl Kwak, Sang-Hyo Kim et al.ICLR 2026 · 29 citations
- A Foundation Model for Error Correction CodesYoni Choukroun, Lior WolfICLR 2024 · 24 citations
- Deep Quantum Error CorrectionYoni Choukroun, Lior WolfAAAI 2024 · 18 citations
- Learning Linear Block Error Correction CodesYoni Choukroun, Lior WolfICML 2024 · 18 citations
- DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep LearningS. Ashwin Hebbar, Sravan Kumar Ankireddy, Hyeji Kim, Sewoong Oh et al.ICML 2024 · 14 citations
Builds on8
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- DiffWave: A Versatile Diffusion Model for Audio SynthesisZhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao et al.ICLR 2021 · 1,902 citations
Related papers
- Error Correction Code TransformerYoni Choukroun, Lior WolfNeurIPS 2022 · 121 citations
- Score Based Error Correcting Code DecoderAlon Helvits, Eliya NachmaniICML 2026
- Doubly Residual Neural Decoder: Towards Low-Complexity High-Performance Channel DecodingSiyu Liao, Chunhua Deng, Miao Yin, Bo YuanAAAI 2021 · 8 citations
- Progressive Compression with Universally Quantized Diffusion ModelsYibo Yang, Justus C. Will, Stephan MandtICLR 2025
- Improving Diffusion-Based Image Restoration with Error Contraction and Error CorrectionQiqi Bao, Zheng Hui, Rui Zhu, Peiran Ren et al.AAAI 2024 · 5 citations
