SD-PSFNet: Sequential and Dynamic Point Spread Function Network for Image Deraining
Jiayu Wang, Haoyu Bian, Haoran Sun, Shaoning Zeng
Abstract
Image deraining is crucial for vision applications but is challenged by the complex multi-scale physics of rain and its coupling with scenes. To address this challenge, a novel approach inspired by multi-stage image restoration is proposed, incorporating Point Spread Function (PSF) mechanisms to reveal the image degradation process while combining dynamic physical modeling with sequential feature fusion transfer, named SD-PSFNet. Specifically, SD-PSFNet employs a sequential restoration architecture with three cascaded stages, allowing multiple dynamic evaluations and refinements of the degradation process estimation. The network utilizes components with learned PSF mechanisms to dynamically simulate rain streak optics, enabling effective rain-background separation while progressively enhancing outputs through novel PSF components at each stage. Additionally, SD-PSFNet incorporates adaptive gated fusion for optimal cross-stage feature integration, enabling sequential refinement from coarse rain removal to fine detail restoration. Our model achieves state-of-the-art PSNR/S-SIM metrics on Rain100H (33.12dB/0.9371), RealRain-1k-L (42.28dB/0.9872), and RealRain-1k-H (41.08dB/0.9838). In summary, SD-PSFNet demonstrates excellent capability in complex scenes and dense rainfall conditions, providing a new physics-aware approach to image deraining.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4992ba3c-9308-4d6c-b19e-2cf46aa109d6Builds on7
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou et al.CVPR 2022 · 1,970 citations
- PromptIR: Prompting for All-in-One Image RestorationVaishnav Potlapalli, Syed Waqas Zamir, Salman H. Khan, Fahad Shahbaz KhanNeurIPS 2023 · 386 citations
- Robust Representation Learning With Feedback for Single Image DerainingChenghao Chen, Hao LiCVPR 2021
- Multi-Stage Progressive Image RestorationSyed Waqas Zamir, Aditya Arora, Salman H. Khan, Munawar Hayat et al.CVPR 2021
Related papers
- Multi-Scale Progressive Fusion Network for Single Image DerainingKui Jiang, Zhongyuan Wang, Peng Yi, Chen Chen et al.CVPR 2020
- Robust Attention Deraining Network for Synchronous Rain Streaks and Raindrops RemovalYanyan Wei, Zhao Zhang, Mingliang Xu, Richang Hong et al.ACM MM 2022 · 19 citations
- Structure-Preserving Deraining with Residue Channel Prior GuidanceQiaosi Yi, Juncheng Li, Qinyan Dai, Faming Fang et al.ICCV 2021 · 159 citations
- Removing Raindrops and Rain Streaks in One GoRuijie Quan, Xin Yu, Yuanzhi Liang, Yi YangCVPR 2021
- Close the Loop: A Unified Bottom-Up and Top-Down Paradigm for Joint Image Deraining and SegmentationYi Li, Yi Chang, Changfeng Yu, Luxin YanAAAI 2022 · 31 citations
