Spatial-Spectral Residuals Informed Diffusion Neural Operator for Pan-sharpening
Jiahan Huang, Ran Ran, Junming Hou, Zihao Chen, Xiaofeng Cong, Junling Li, Liang-Jian Deng
摘要
Pan-sharpening, a fundamental image preprocessing technique in remote sensing, aims to generate spatially and spectrally enriched multispectral imagery by integrating complementary information from texture-rich panchromatic (PAN) images and paired low-resolution multispectral (LRMS) counterparts. Although recent generative diffusion models have achieved impressive fusion quality, these performance gains often come with substantial computational costs, rendering them impractical for resource-constrained scenarios common in remote sensing applications. This work introduces a function-space diffusion model built upon a neural operator architecture that achieves compelling performance with promising efficiency. Specifically, our framework replaces the standard attention-based denoising backbone with a Galerkin-type neural operator, significantly reducing computational complexity while maintaining excellent representational capacity. Furthermore, by explicitly integrating pixel-wise spatial-spectral consistency residuals into each reverse diffusion step, our method establishes a fine-grained, closed-loop guidance mechanism that dynamically calibrates spatial details and spectral fidelity throughout the generation process. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of our approach over state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Fourmer: An Efficient Global Modeling Paradigm for Image RestorationMan Zhou, Jie Huang, Chun-Le Guo, Chongyi LiICML 2023 · 被引用 148 次
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone 等AAAI 2022 · 被引用 131 次
- Pan-Sharpening with Customized Transformer and Invertible Neural NetworkMan Zhou, Jie Huang, Yanchi Fang, Xueyang Fu 等AAAI 2022 · 被引用 130 次
相关 Paper
- NODiff: Neural Operator Diffusion for Multispectral Image FusionJunming Hou, Ran Ran, Sixing Chen, Zihao Chen 等AAAI 2026
- Accelerated Diffusion via High-Low Frequency Decomposition for Pan-SharpeningGe Meng, Jingjia Huang, Jingyan Tu, Yingying Wang 等AAAI 2025 · 被引用 3 次
- SSDiff: Spatial-spectral Integrated Diffusion Model for Remote Sensing PansharpeningYu Zhong, Xiao Wu, Liang-Jian Deng, Zihan Cao 等NeurIPS 2024 · 被引用 28 次
- Physics-informed Neural Operator for PansharpeningXinyang Liu, Junming Hou, Chenxu Wu, Xiaofeng Cong 等NeurIPS 2025 · 被引用 2 次
- Hyperspectral Pansharpening via Diffusion Models with Iteratively Zero-Shot GuidanceJin-Liang Xiao, Ting-Zhu Huang, Liang-Jian Deng, Guang Lin 等CVPR 2025
