Gradient as Conditions: Rethinking HOG for All-in-one Image Restoration
Jiawei Wu, Zhifei Yang, Zhe Wang, Zhi Jin
Abstract
All-in-one image restoration (AIR) aims to address diverse degradations within a unified model by leveraging informative degradation conditions to guide the restoration process. However, existing methods often rely on implicitly learned priors, which may entangle feature representations and hinder performance in complex or unseen scenarios. Histogram of Oriented Gradients (HOG) as a classical gradient representation, we observe that it has strong discriminative capability across diverse degradations, making it a powerful and interpretable prior for AIR. Based on this insight, we propose HOGformer, a Transformer-based model that integrates learnable HOG features for degradation-aware restoration. The core of HOGformer is a Dynamic HOG-aware Self-Attention (DHOGSA) mechanism, which adaptively models long-range spatial dependencies conditioned on degradationspecific cues encoded by HOG descriptors. To further adapt the heterogeneity of degradations in AIR, we propose a Dynamic Interaction Feed-Forward (DIFF) module that facilitates channel-spatial interactions, enabling robust feature transformation under diverse degradations. Besides, we propose a HOG loss to explicitly enhance structural fidelity and edge sharpness. Extensive experiments on a variety of benchmarks, including adverse weather and natural degradations, demonstrate that HOGformer achieves state-of-the-art performance and generalizes well to complex real-world scenarios. Code is available at https://github.com/Fire-friend/ HOGformer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d43e5d39-42d6-41ca-84a7-19bfc1c01099Builds on28
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou et al.CVPR 2022 · 1,970 citations
- Retinexformer: One-stage Retinex-based Transformer for Low-light Image EnhancementYuanhao Cai, Hao Bian, Jing Lin, Haoqian Wang et al.ICCV 2023 · 615 citations
- MAXIM: Multi-Axis MLP for Image ProcessingZhengzhong Tu, Hossein Talebi, Han Zhang, Feng Yang et al.CVPR 2022 · 550 citations
- PromptIR: Prompting for All-in-One Image RestorationVaishnav Potlapalli, Syed Waqas Zamir, Salman H. Khan, Fahad Shahbaz KhanNeurIPS 2023 · 386 citations
Related papers
- Robust Adverse Weather Removal via Spectral-based Spatial GroupingYuhwan Jeong, Yunseo Yang, Youngho Yoon, Kuk-Jin YoonICCV 2025 · 1 citation
- All-in-One Image Restoration for Unknown Degradations Using Adaptive Discriminative Filters for Specific DegradationsDongwon Park, Byung Hyun Lee, Se Young ChunCVPR 2023
- Rethinking Expressivity and Degradation-Awareness in Attention for All-in-One Blind Image RestorationBin Ren, Runyi Yang, Qi Ma, Xu Zheng et al.ICLR 2026
- Bend the Basics: Degradation-Aware Deformable Tokenization for All-in-One Image RestorationZihao He, Yunfeng Wu, Xinchao Wang, Songhua LiuICML 2026
- ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image RestorationXu Zhang, Huan Zhang, Guoli Wang, Qian Zhang et al.AAAI 2026 · 6 citations
