Masked Image Training for Generalizable Deep Image Denoising
Haoyu Chen, Jinjin Gu, Yihao Liu, Salma Abdel Magid, Chao Dong, Qiong Wang, Hanspeter Pfister, Lei Zhu
摘要
When capturing and storing images, devices inevitably introduce noise. Reducing this noise is a critical task called image denoising. Deep learning has become the de facto method for image denoising, especially with the emergence of Transformer-based models that have achieved notable state-of-the-art results on various image tasks. However, deep learning-based methods often suffer from a lack of generalization ability. For example, deep models trained on Gaussian noise may perform poorly when tested on other noise distributions. To address this issue, we present a novel approach to enhance the generalization performance of denoising networks, known as masked training. Our method involves masking random pixels of the input image and reconstructing the missing information during training. We also mask out the features in the self-attention layers to avoid the impact of training-testing inconsistency. Our approach exhibits better generalization ability than other deep learning models and is directly applicable to realworld scenarios. Additionally, our interpretability analysis demonstrates the superiority of our method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper33
- Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image FusionXunpeng Yi, Han Xu, Hao Zhang, Linfeng Tang 等CVPR 2024 · 被引用 121 次
- Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the WildFanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu 等CVPR 2024 · 被引用 87 次
- DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset CurationYuang Ai, Xiaoqiang Zhou, Huaibo Huang, Xiaotian Han 等NeurIPS 2024 · 被引用 81 次
- Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain StreaksSixiang Chen, Tian Ye, Jinbin Bai, Erkang Chen 等ICCV 2023 · 被引用 72 次
- I2EBench: A Comprehensive Benchmark for Instruction-based Image EditingYiwei Ma, Jiayi Ji, Ke Ye, Weihuang Lin 等NeurIPS 2024 · 被引用 67 次
它引用的顶会 Paper24
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- BEiT: BERT Pre-Training of Image TransformersHangbo Bao, Li Dong, Songhao Piao, Furu WeiICLR 2022 · 被引用 3,632 次
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou 等CVPR 2022 · 被引用 1,970 次
- Generative Pretraining From PixelsMark Chen, Alec Radford, Rewon Child, Jeffrey Wu 等ICML 2020 · 被引用 1,773 次
相关 Paper
- Noisier2Noise: Learning to Denoise From Unpaired Noisy DataNick Moran, Dan Schmidt, Yu Zhong, Patrick CoadyCVPR 2020
- Learning with Noisy labels via Self-supervised Adversarial Noisy MaskingYuanpeng Tu, Boshen Zhang, Yuxi Li, Liang Liu 等CVPR 2023
- Self-Calibrated Variance-Stabilizing Transformations for Real-World Image DenoisingSébastien Herbreteau, Michael UnserICCV 2025 · 被引用 3 次
- Random Is All You Need: Random Noise Injection on Feature Statistics for Generalizable Deep Image DenoisingZhengwei Yin, Hongjun Wang, Guixu Lin, Weihang Ran 等ICLR 2025
- An Unsupervised Deep Learning Approach for Real-World Image DenoisingDihan Zheng, Sia Huat Tan, Xiaowen Zhang, Zuoqiang Shi 等ICLR 2021 · 被引用 29 次
