Spatial-Spectral Residuals Informed Diffusion Neural Operator for Pan-sharpening
Jiahan Huang, Ran Ran, Junming Hou, Zihao Chen, Xiaofeng Cong, Junling Li, Liang-Jian Deng
Abstract
Pan-sharpening, a fundamental image preprocessing technique in remote sensing, aims to generate spatially and spectrally enriched multispectral imagery by integrating complementary information from texture-rich panchromatic (PAN) images and paired low-resolution multispectral (LRMS) counterparts. Although recent generative diffusion models have achieved impressive fusion quality, these performance gains often come with substantial computational costs, rendering them impractical for resource-constrained scenarios common in remote sensing applications. This work introduces a function-space diffusion model built upon a neural operator architecture that achieves compelling performance with promising efficiency. Specifically, our framework replaces the standard attention-based denoising backbone with a Galerkin-type neural operator, significantly reducing computational complexity while maintaining excellent representational capacity. Furthermore, by explicitly integrating pixel-wise spatial-spectral consistency residuals into each reverse diffusion step, our method establishes a fine-grained, closed-loop guidance mechanism that dynamically calibrates spatial details and spectral fidelity throughout the generation process. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of our approach over state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Fourmer: An Efficient Global Modeling Paradigm for Image RestorationMan Zhou, Jie Huang, Chun-Le Guo, Chongyi LiICML 2023 · 148 citations
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone et al.AAAI 2022 · 131 citations
- Pan-Sharpening with Customized Transformer and Invertible Neural NetworkMan Zhou, Jie Huang, Yanchi Fang, Xueyang Fu et al.AAAI 2022 · 130 citations
Related papers
- NODiff: Neural Operator Diffusion for Multispectral Image FusionJunming Hou, Ran Ran, Sixing Chen, Zihao Chen et al.AAAI 2026
- Accelerated Diffusion via High-Low Frequency Decomposition for Pan-SharpeningGe Meng, Jingjia Huang, Jingyan Tu, Yingying Wang et al.AAAI 2025 · 3 citations
- SSDiff: Spatial-spectral Integrated Diffusion Model for Remote Sensing PansharpeningYu Zhong, Xiao Wu, Liang-Jian Deng, Zihan Cao et al.NeurIPS 2024 · 28 citations
- Physics-informed Neural Operator for PansharpeningXinyang Liu, Junming Hou, Chenxu Wu, Xiaofeng Cong et al.NeurIPS 2025 · 2 citations
- Hyperspectral Pansharpening via Diffusion Models with Iteratively Zero-Shot GuidanceJin-Liang Xiao, Ting-Zhu Huang, Liang-Jian Deng, Guang Lin et al.CVPR 2025
