Seeing Through the Rain: Resolving High-Frequency Conflicts in Deraining and Super-Resolution via Diffusion Guidance
Wenjie Li, Jinglei Shi, Jin Han, Heng Guo, Zhanyu Ma
摘要
Clean images are crucial for visual tasks such as small object detection, especially at high resolutions. However, real-world images are often degraded by adverse weather, and weather restoration methods may sacrifice high-frequency details critical for analyzing small objects. A natural solution is to apply super-resolution (SR) after weather removal to recover both clarity and fine structures. However, simply cascading restoration and SR struggle to bridge their inherent conflict: removal aims to remove high-frequency weather-induced noise, while SR aims to hallucinate high-frequency textures from existing details, leading to inconsistent restoration contents. In this paper, we take deraining as a case study and propose DHGM, a Diffusion-based High-frequency Guided Model for generating clean and high-resolution images. DHGM integrates pre-trained diffusion priors with high-pass filters to simultaneously remove rain artifacts and enhance structural details. Extensive experiments demonstrate that DHGM achieves superior performance over existing methods, with lower costs. Code link: https://github.com/PRIS-CV/DHGM .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper26
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetLi Yuan, Yunpeng Chen, Tao Wang, Weihao Yu 等ICCV 2021 · 被引用 2,462 次
- DiffIR: Efficient Diffusion Model for Image RestorationBin Xia, Yulun Zhang, Shiyin Wang, Yitong Wang 等ICCV 2023 · 被引用 410 次
相关 Paper
- Close the Loop: A Unified Bottom-Up and Top-Down Paradigm for Joint Image Deraining and SegmentationYi Li, Yi Chang, Changfeng Yu, Luxin YanAAAI 2022 · 被引用 31 次
- ResDiff: Combining CNN and Diffusion Model for Image Super-resolutionShuyao Shang, Zhengyang Shan, Guangxing Liu, Lunqian Wang 等AAAI 2024 · 被引用 158 次
- Multi-Decoding Deraining Network and Quasi-Sparsity Based TrainingYinglong Wang, Chao Ma, Bing ZengCVPR 2021
- PromptRestorer: A Prompting Image Restoration Method with Degradation PerceptionCong Wang, Jinshan Pan, Wei Wang, Jiangxin Dong 等NeurIPS 2023 · 被引用 109 次
- Adapting Text-to-Image Generation with Feature Difference Instruction for Generic Image RestorationChao Wang, Hehe Fan, Huichen Yang, Sarvnaz Karimi 等CVPR 2025
