UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization
Qianfeng Yang, Qiyuan Guan, Xiang Chen, Jiyu Jin, Guiyue Jin, Jiangxin Dong
摘要
Despite significant progress has been made in image deraining, we note that most existing methods are often developed for only specific types of rain degradation and fail to generalize across diverse real-world rainy scenes. How to effectively model different rain degradations within a universal framework is important for real-world image deraining. In this paper, we propose UniRain, an effective unified image deraining framework capable of restoring images degraded by rain streak and raindrop under both daytime and nighttime conditions. To better enhance unified model generalization, we construct an intelligent retrieval augmented generation (RAG)-based dataset distillation pipeline that selects high-quality training samples from all public deraining datasets for better mixed training. Furthermore, we incorporate a simple yet effective multi-objective reweighted optimization strategy into the asymmetric mixture-of-experts (MoE) architecture to facilitate consistent performance and improve robustness across diverse scenes. Extensive experiments show that our framework performs consistently favorably against the state-of-the-art models on both our proposed benchmarks and multiple public datasets. Code and dataset will be available.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper24
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 被引用 6,549 次
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine 等NeurIPS 2020 · 被引用 2,261 次
相关 Paper
- Towards Universal Rainy Image Restoration: Benchmark and BaselineHujie YanAAAI 2025 · 被引用 4 次
- Learning Weather-General and Weather-Specific Features for Image Restoration Under Multiple Adverse Weather ConditionsYurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang 等CVPR 2023
- Improving De-raining Generalization via Neural ReorganizationJie Xiao, Man Zhou, Xueyang Fu, Aiping Liu 等ICCV 2021 · 被引用 21 次
- Unpaired Learning for Deep Image Deraining with Rain Direction RegularizerYang Liu, Ziyu Yue, Jinshan Pan, Zhixun SuICCV 2021 · 被引用 56 次
- Removing Raindrops and Rain Streaks in One GoRuijie Quan, Xin Yu, Yuanzhi Liang, Yi YangCVPR 2021
