CARD: Correlation Aware Restoration with Diffusion
Niki Nezakati, Arnab Ghosh, Amit Roy-Chowdhury, Vishwanath Saragadam
摘要
Denoising diffusion models have achieved state-of-the-art performance in image restoration by modeling the process as sequential denoising steps. However, most approaches assume independent and identically distributed (i.i.d.) Gaussian noise, while real-world sensors often exhibit spatially correlated noise due to readout mechanisms, limiting their practical effectiveness. We introduce Correlation Aware Restoration with Diffusion (CARD), a training-free extension of DDRM that explicitly handles correlated Gaussian noise. CARD first whitens the noisy observation, which converts the noise into an i.i.d. form. Then, the diffusion restoration steps are replaced with noise-whitened updates, which inherits DDRM's closed-form sampling efficiency while now being able to handle correlated noise. To emphasize the importance of addressing correlated noise, we contribute CIN-D, a novel correlated noise dataset captured across diverse illumination conditions to evaluate restoration methods on real rolling-shutter sensor noise. This dataset fills a critical gap in the literature for experimental evaluation with real-world correlated noise. Experiments on standard benchmarks with synthetic correlated noise and on CIN-D demonstrate that CARD consistently outperforms existing methods across denoising, deblurring, and super-resolution tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 被引用 1,439 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- ILVR: Conditioning Method for Denoising Diffusion Probabilistic ModelsJooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon 等ICCV 2021 · 被引用 933 次
相关 Paper
- Single Image Rolling Shutter Removal with Diffusion ModelsZhanglei Yang, Haipeng Li, Mingbo Hong, Chen-Lin Zhang 等AAAI 2025 · 被引用 6 次
- Realistic Noise Synthesis with Diffusion ModelsQi Wu, Mingyan Han, Ting Jiang, Chengzhi Jiang 等AAAI 2025 · 被引用 6 次
- Blue noise for diffusion modelsXingchang Huang, Corentin Salaün, Cristina Nader Vasconcelos, Christian Theobalt 等SIGGRAPH 2024 · 被引用 11 次
- Rethinking Noise Synthesis and Modeling in Raw DenoisingYi Zhang, Hongwei Qin, Xiaogang Wang, Hongsheng LiICCV 2021 · 被引用 100 次
- DreamClean: Restoring Clean Image Using Deep Diffusion PriorJie Xiao, Ruili Feng, Han Zhang, Zhiheng Liu 等ICLR 2024 · 被引用 23 次
