EMR-Diff: Edge-aware Multimodal Residual Diffusion Model for Hyperspectral Image Super-resolution
Tao Zhang, Shengtao Yao, Rong Zeng, Zunjie Zhu, Bolun Zheng, Yaoqi Sun, Ying Fu, Chenggang Yan
Abstract
Hardware constraints make it challenging to simultaneously acquire hyperspectral images (HSIs) with both high spatial and high spectral resolutions. A promising solution is to fuse low-resolution HSI (LR-HSI) with high-resolution multispectral images (HR-MSI) to generate high-resolution HSI (HR-HSI). Recently, diffusion models have introduced possibilities for HSI super-resolution, but suffer from lowefficiency sampling, detail-limited generation, and insufficient denoising. To address these issues, we propose an Edge-aware Multimodal Residual Diffusion Model (EMR-Diff). Specifically, multimodal residual mechanism is introduced to facilitate efficient information transfer among HR-MSI, LR-HSI, and HR-HSI, significantly improving the fusion efficiency. Edge-aware noise strategy is designed by exploiting the edge information of HR-MSI, which guides the model to prioritize high-frequency detail reconstruction by applying stronger noise perturbations to edge regions. In addition, we propose a Bilateral Attention Fusion UNet and design a multi-scale supervision mechanism to enable progressive reconstruction and collaborative optimization of spectral and spatial features. Extensive experiments demonstrate that our method achieves superior performance over existing approaches in both quantitative metrics and visual quality. Our code is available at: https://github.com/luocz55/EMR-Diff.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d9ac7e7b-91c6-46dc-bb76-cc322763e8d5Builds on7
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- ResShift: Efficient Diffusion Model for Image Super-resolution by Residual ShiftingZongsheng Yue, Jianyi Wang, Chen Change LoyNeurIPS 2023 · 646 citations
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone et al.AAAI 2022 · 131 citations
- HSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion ModelsChanyue Wu, Dong Wang, Yunpeng Bai, Hanyu Mao et al.ICCV 2023 · 78 citations
- ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolutionMingjin Zhang, Chi Zhang, Qiming Zhang, Jie Guo et al.ICCV 2023 · 73 citations
Related papers
- S2CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Framework for Hyperspectral Image Super-resolutionJiahui Qu, Jie He, Wenqian Dong, Jingyu ZhaoAAAI 2024 · 16 citations
- Self-Learning Hyperspectral and Multispectral Image Fusion via Adaptive Residual Guided Subspace Diffusion ModelJian Zhu, He Wang, Yang Xu, Zebin Wu et al.CVPR 2025
- MFTN: A Multi-scale Feature Transfer Network Based on IMatchFormer for Hyperspectral Image Super-ResolutionShuying Huang, Mingyang Ren, Yong Yang, Xiaozheng Wang et al.ICML 2024 · 2 citations
- Learning Multi-Modal Cross-Scale Deformable Transformer Network for Unregistered Hyperspectral Image Super-resolutionWenqian Dong, Yang Xu, Jiahui Qu, Shaoxiong HouAAAI 2024 · 12 citations
- Deep Blind Hyperspectral Image FusionWu Wang, Weihong Zeng, Yue Huang, Xinghao Ding et al.ICCV 2019 · 106 citations
