Piercing the Fog: Disentangling Key Features for Vision Models in Multi-Degradation Scenarios
Siyu Chen, Shiqiang Ma, Fei Guo
Abstract
In natural scenarios, vision models often encounter the challenge of complex degradation scenarios(e.g., rain, snow, fog, or motion blur). These degradations severely corrupt image features, causing existing models to treat rarely seen or unseen degraded images as “unfamiliar”, thereby losing their inherent recognition and perception capabilities. To address this challenge, we propose a novel degradation disentanglement model (DDM) aimed at precisely disentangling degraded features from the image. The model enhances its perception of various degradations by controlling the matching of features across different degradation types and further strengthens the cross-correlation of target features by introducing a degradation suppression module. This enables the model to re-identify and re-localize targets while removing degradations. We validated the effectiveness of our method on more challenging few-shot segmentation datasets Degraded-Pascal and Degraded-COCO. Results on them outperform SOTA with 3.71% and 3.69% improvement respectively. The experimental results show that our method significantly improves the performance of vision models in various degradation scenarios and provides new ideas and solutions for visual understanding tasks in complex environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on25
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Sigmoid Loss for Language Image Pre-TrainingXiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, Lucas BeyerICCV 2023 · 2,932 citations
- Real Image Denoising With Feature AttentionSaeed Anwar, Nick BarnesICCV 2019 · 644 citations
- TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather ConditionsJeya Maria Jose Valanarasu, Rajeev Yasarla, Vishal M. PatelCVPR 2022 · 350 citations
Related papers
- Continuous Adverse Weather Removal via Degradation-Aware DistillationXin Lu, Jie Xiao, Yurui Zhu, Xueyang FuCVPR 2025
- All-in-One Image Restoration for Unknown Degradations Using Adaptive Discriminative Filters for Specific DegradationsDongwon Park, Byung Hyun Lee, Se Young ChunCVPR 2023
- Real-World Person Re-Identification via Degradation Invariance LearningYukun Huang, Zheng-Jun Zha, Xueyang Fu, Richang Hong et al.CVPR 2020
- GIQE: Generic Image Quality Enhancement via Nth Order Iterative DegradationPranjay Shyam, Kyung-Soo Kim, Kuk-Jin YoonCVPR 2022 · 10 citations
- MdaIF: Robust One-Stop Multi-Degradation-Aware Image Fusion with Language-Driven SemanticsJing Li, Yifan Wang, Jiafeng Yan, Renlong Zhang et al.AAAI 2026
