Enpowering Your Pansharpening Models with Generalizability: Unified Distribution Is All You Need
Yongchuan Cui, Peng Liu, Hui Zhang
Abstract
Existing deep learning-based models for remote sensing pansharpening exhibit exceptional performance on training datasets. However, due to sensor-specific characteristics and varying imaging conditions, these models suffer from substantial performance degradation when applied to unseen satellite data, lacking generalizability and thus limiting their applicability. We argue that the performance drops stem primarily from distributional discrepancies from different sources and the key to addressing this challenge lies in bridging the gap between training and testing distributions. To validate the idea and further achieve a "train once, deploy forever" capability, this paper introduces a novel and intuitive approach to enpower any pansharpening models with generalizability by employing a unified distribution strategy (UniPAN). Specifically, we construct a distribution transformation function that normalizes the pixels sampled from different sources to conform to an identical distribution. The deep models are trained on the transformed domain, and during testing on new datasets, the new data are also transformed to match the training distribution. UniPAN aims to train and test the model on a unified and consistent distribution, thereby enhancing its generalizability. Extensive experiments validate the efficacy of UniPAN, demonstrating its potential to significantly enhance the performance of deep pansharpening models across diverse satellite sensors. Codes: https://github.com/yc-cui/UniPAN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bc2c4d71-c64e-444b-afe4-f14b15c6dbfbBuilds on12
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- HyperTransformer: A Textural and Spectral Feature Fusion Transformer for PansharpeningWele Gedara Chaminda Bandara, Vishal M. PatelCVPR 2022 · 175 citations
- LAGConv: Local-Context Adaptive Convolution Kernels with Global Harmonic Bias for PansharpeningZi-Rong Jin, Tian-Jing Zhang, Tai-Xiang Jiang, Gemine Vivone et al.AAAI 2022 · 131 citations
- Memory-augmented Deep Conditional Unfolding Network for PansharpeningGang Yang, Man Zhou, Keyu Yan, Aiping Liu et al.CVPR 2022 · 82 citations
Related papers
- Training and Inference Within 1 Second - Tackle Cross-Sensor Degradation of Real-World Pansharpening with Efficient Residual Feature TailoringTianyu Xin, Jin-Liang Xiao, Zeyu Xia, Shan Yin et al.AAAI 2026 · 1 citation
- Training Pansharpening Networks at Full Resolution Using Degenerate InvarianceYichang Qu, Bing Li, Jie Huang, Feng ZhaoACM MM 2024
- Probability-based Global Cross-modal Upsampling for PansharpeningZeyu Zhu, Xiangyong Cao, Man Zhou, Junhao Huang et al.CVPR 2023
- Deep Gradient Projection Networks for Pan-sharpeningShuang Xu, Jiangshe Zhang, Zixiang Zhao, Kai Sun et al.CVPR 2021
- SWIFT:A General Sensitive Weight Identification Framework for Fast Sensor-Transfer PansharpeningZeyu Xia, Chenxi Sun, Tianyu Xin, Yubo Zeng et al.AAAI 2026
