OTPNet: ODE-inspired Tuning-free Proximal Network for Remote Sensing Image Fusion
Wei Yu, Zonglin Li, Qinglin Liu, Xin Sun
Abstract
Remote sensing image fusion aims to reconstruct a high spatial and spectral resolution image by integrating the spatial and spectral information from multiple remote sensing sensor data. Despite the remarkable progress of deep learningbased fusion methods, most existing methods rely on manual network architecture design and hyperparameter tuning, lacking sufficient interpretability and adaptability. To address this limitation, we propose a novel neural Ordinary Differential Equation (ODE)-inspired tuning-free proximal splitting algorithm, which splits remote sensing image fusion into two optimization problems regularized by deep priors to model the fusion of spatial and spectral. Firstly, based on the physical properties of spatial and spectral information, the two problems are optimized by two proximal splitting operators to iteratively integrate spatial-spectral complementary information, eliminating or suppressing redundant information to reduce fusion errors. Secondly, considering the efficiency of neural ODE in reducing optimization error, we utilize a high-order numerical scheme to customize the proximal operator theoretically without additional handcrafted design and parameter tuning. Finally, by incorporating the numerical scheme as a solver into the proximal optimization algorithm, we derive an ODE-inspired Tuning-free Proximal Network, dubbed OTP-Net, which achieves efficient and robust fusion reconstruction. Extensive experiments on nine datasets across three different remote sensing image fusion tasks show that our OTP-Net outperforms existing state-of-the-art approaches, which validates the effectiveness of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext de5c0e94-dcdd-4a27-a3ca-d40c5a42b1feBuilds on8
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone et al.AAAI 2022 · 131 citations
- Pan-Sharpening with Customized Transformer and Invertible Neural NetworkMan Zhou, Jie Huang, Yanchi Fang, Xueyang Fu et al.AAAI 2022 · 130 citations
- Memory-augmented Deep Conditional Unfolding Network for PansharpeningGang Yang, Man Zhou, Keyu Yan, Aiping Liu et al.CVPR 2022 · 82 citations
- SSconv: Explicit Spectral-to-Spatial Convolution for PansharpeningYudong Wang, Liang-Jian Deng, Tian-Jing Zhang, Xiao WuACM MM 2021 · 63 citations
- U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image FusionSiran Peng, Chenhao Guo, Xiao Wu, Liang-Jian DengACM MM 2023 · 43 citations
Related papers
- Proximal PanNet: A Model-Based Deep Network for PansharpeningXiangyong Cao, Yang Chen, Wenfei CaoAAAI 2022 · 17 citations
- HNO: High-Order Numerical Architecture for ODE-Inspired Deep Unfolding NetworksLin Kong, Wei Sun, Fanhua Shang, Yuanyuan Liu et al.AAAI 2022 · 1 citation
- DNU: Deep Non-Local Unrolling for Computational Spectral ImagingLizhi Wang, Chen Sun, Maoqing Zhang, Ying Fu et al.CVPR 2020
- OTIAS: OcTree Implicit Adaptive Sampling for Multispectral and Hyperspectral Image FusionShangqi Deng, Jun Ma, Liang-Jian Deng, Ping WeiAAAI 2025 · 10 citations
- Deep Generalized Unfolding Networks for Image RestorationChong Mou, Qian Wang, Jian ZhangCVPR 2022 · 257 citations
