OTPNet: ODE-inspired Tuning-free Proximal Network for Remote Sensing Image Fusion
Wei Yu, Zonglin Li, Qinglin Liu, Xin Sun
摘要
Remote sensing image fusion aims to reconstruct a high spatial and spectral resolution image by integrating the spatial and spectral information from multiple remote sensing sensor data. Despite the remarkable progress of deep learningbased fusion methods, most existing methods rely on manual network architecture design and hyperparameter tuning, lacking sufficient interpretability and adaptability. To address this limitation, we propose a novel neural Ordinary Differential Equation (ODE)-inspired tuning-free proximal splitting algorithm, which splits remote sensing image fusion into two optimization problems regularized by deep priors to model the fusion of spatial and spectral. Firstly, based on the physical properties of spatial and spectral information, the two problems are optimized by two proximal splitting operators to iteratively integrate spatial-spectral complementary information, eliminating or suppressing redundant information to reduce fusion errors. Secondly, considering the efficiency of neural ODE in reducing optimization error, we utilize a high-order numerical scheme to customize the proximal operator theoretically without additional handcrafted design and parameter tuning. Finally, by incorporating the numerical scheme as a solver into the proximal optimization algorithm, we derive an ODE-inspired Tuning-free Proximal Network, dubbed OTP-Net, which achieves efficient and robust fusion reconstruction. Extensive experiments on nine datasets across three different remote sensing image fusion tasks show that our OTP-Net outperforms existing state-of-the-art approaches, which validates the effectiveness of our method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone 等AAAI 2022 · 被引用 131 次
- Pan-Sharpening with Customized Transformer and Invertible Neural NetworkMan Zhou, Jie Huang, Yanchi Fang, Xueyang Fu 等AAAI 2022 · 被引用 130 次
- Memory-augmented Deep Conditional Unfolding Network for PansharpeningGang Yang, Man Zhou, Keyu Yan, Aiping Liu 等CVPR 2022 · 被引用 82 次
- SSconv: Explicit Spectral-to-Spatial Convolution for PansharpeningYudong Wang, Liang-Jian Deng, Tian-Jing Zhang, Xiao WuACM MM 2021 · 被引用 63 次
- U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image FusionSiran Peng, Chenhao Guo, Xiao Wu, Liang-Jian DengACM MM 2023 · 被引用 43 次
相关 Paper
- Proximal PanNet: A Model-Based Deep Network for PansharpeningXiangyong Cao, Yang Chen, Wenfei CaoAAAI 2022 · 被引用 17 次
- HNO: High-Order Numerical Architecture for ODE-Inspired Deep Unfolding NetworksLin Kong, Wei Sun, Fanhua Shang, Yuanyuan Liu 等AAAI 2022 · 被引用 1 次
- DNU: Deep Non-Local Unrolling for Computational Spectral ImagingLizhi Wang, Chen Sun, Maoqing Zhang, Ying Fu 等CVPR 2020
- OTIAS: OcTree Implicit Adaptive Sampling for Multispectral and Hyperspectral Image FusionShangqi Deng, Jun Ma, Liang-Jian Deng, Ping WeiAAAI 2025 · 被引用 10 次
- Deep Generalized Unfolding Networks for Image RestorationChong Mou, Qian Wang, Jian ZhangCVPR 2022 · 被引用 257 次
