Semantics and Content Matter: Towards Multi-Prior Hierarchical Mamba for Image Deraining
Zhaocheng Yu, Kui Jiang, Junjun Jiang, Xianming Liu, Guanglu Sun, Yi Xiao
摘要
Rain significantly degrades the performance of computer vision systems, particularly in applications like autonomous driving and video surveillance. While existing deraining methods have made considerable progress, they often struggle with fidelity of semantic and spatial details. To address these limitations, we propose the Multi-Prior Hierarchical Mamba (MPHM) network for image deraining. This novel architecture synergistically integrates macro-semantic textual priors (CLIP) for task-level semantic guidance and micro-structural visual priors (DINOv2) for scene-aware structural information. To alleviate potential conflicts between heterogeneous priors, we devise a progressive Priors Fusion Injection (PFI) that strategically injects complementary cues at different decoder levels. Meanwhile, we equip the backbone network with an elaborate Hierarchical Mamba Module (HMM) to facilitate robust feature representation, featuring a Fourier-enhanced dual-path design that concurrently addresses global context modeling and local detail recovery. Comprehensive experiments demonstrate MPHM's state-of-the-art performance, achieving a 0.57 dB PSNR gain on the Rain200H dataset while delivering superior generalization on real-world rainy scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- VMamba: Visual State Space ModelYue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu 等NeurIPS 2024 · 被引用 3,199 次
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou 等CVPR 2022 · 被引用 1,970 次
- Structure-Preserving Deraining with Residue Channel Prior GuidanceQiaosi Yi, Juncheng Li, Qinyan Dai, Faming Fang 等ICCV 2021 · 被引用 159 次
相关 Paper
- FreqMamba: Viewing Mamba from a Frequency Perspective for Image DerainingZhen Zou, Hu Yu, Jie Huang, Feng ZhaoACM MM 2024 · 被引用 73 次
- PRE-Mamba: A 4D State Space Model for Ultra-High-Frequent Event Camera DerainingCiyu Ruan, Ruishan Guo, Zihang Gong, Jingao Xu 等ICCV 2025 · 被引用 3 次
- Close the Loop: A Unified Bottom-Up and Top-Down Paradigm for Joint Image Deraining and SegmentationYi Li, Yi Chang, Changfeng Yu, Luxin YanAAAI 2022 · 被引用 31 次
- Multi-Scale Progressive Fusion Network for Single Image DerainingKui Jiang, Zhongyuan Wang, Peng Yi, Chen Chen 等CVPR 2020
- Multi-Decoding Deraining Network and Quasi-Sparsity Based TrainingYinglong Wang, Chao Ma, Bing ZengCVPR 2021
