CARD: Correlation Aware Restoration with Diffusion
Niki Nezakati, Arnab Ghosh, Amit Roy-Chowdhury, Vishwanath Saragadam
Abstract
Denoising diffusion models have achieved state-of-the-art performance in image restoration by modeling the process as sequential denoising steps. However, most approaches assume independent and identically distributed (i.i.d.) Gaussian noise, while real-world sensors often exhibit spatially correlated noise due to readout mechanisms, limiting their practical effectiveness. We introduce Correlation Aware Restoration with Diffusion (CARD), a training-free extension of DDRM that explicitly handles correlated Gaussian noise. CARD first whitens the noisy observation, which converts the noise into an i.i.d. form. Then, the diffusion restoration steps are replaced with noise-whitened updates, which inherits DDRM's closed-form sampling efficiency while now being able to handle correlated noise. To emphasize the importance of addressing correlated noise, we contribute CIN-D, a novel correlated noise dataset captured across diverse illumination conditions to evaluate restoration methods on real rolling-shutter sensor noise. This dataset fills a critical gap in the literature for experimental evaluation with real-world correlated noise. Experiments on standard benchmarks with synthetic correlated noise and on CIN-D demonstrate that CARD consistently outperforms existing methods across denoising, deblurring, and super-resolution tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- ILVR: Conditioning Method for Denoising Diffusion Probabilistic ModelsJooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon et al.ICCV 2021 · 933 citations
Related papers
- Single Image Rolling Shutter Removal with Diffusion ModelsZhanglei Yang, Haipeng Li, Mingbo Hong, Chen-Lin Zhang et al.AAAI 2025 · 6 citations
- Realistic Noise Synthesis with Diffusion ModelsQi Wu, Mingyan Han, Ting Jiang, Chengzhi Jiang et al.AAAI 2025 · 6 citations
- Blue noise for diffusion modelsXingchang Huang, Corentin Salaün, Cristina Nader Vasconcelos, Christian Theobalt et al.SIGGRAPH 2024 · 11 citations
- Rethinking Noise Synthesis and Modeling in Raw DenoisingYi Zhang, Hongwei Qin, Xiaogang Wang, Hongsheng LiICCV 2021 · 100 citations
- DreamClean: Restoring Clean Image Using Deep Diffusion PriorJie Xiao, Ruili Feng, Han Zhang, Zhiheng Liu et al.ICLR 2024 · 23 citations
