Spatial-Spectral Transformer for Hyperspectral Image Denoising
Miaoyu Li, Ying Fu, Yulun Zhang
Abstract
Hyperspectral image (HSI) denoising is a crucial preprocessing procedure for the subsequent HSI applications. Unfortunately, though witnessing the development of deep learning in HSI denoising area, existing convolution-based methods face the trade-off between computational efficiency and capability to model non-local characteristics of HSI. In this paper, we propose a Spatial-Spectral Transformer (SST) to alleviate this problem. To fully explore intrinsic similarity characteristics in both spatial dimension and spectral dimension, we conduct non-local spatial self-attention and global spectral self-attention with Transformer architecture. The window-based spatial self-attention focuses on the spatial similarity beyond the neighboring region. While, the spectral self-attention exploits the long-range dependencies between highly correlative bands. Experimental results show that our proposed method outperforms the state-of-the-art HSI denoising methods in quantitative quality and visual results. The code is released at https://github.com/MyuLi/SST.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext de25ecdf-0398-4f19-8fc5-e72bca6f3e7dCited by top-tier papers14
- DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image RestorationYuchun Miao, Lefei Zhang, Liangpei Zhang, Dacheng TaoICCV 2023 · 64 citations
- Hybrid Spectral Denoising Transformer with Guided AttentionZeqiang Lai, Chenggang Yan, Ying FuICCV 2023 · 35 citations
- HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion ModelsLi Pang, Xiangyu Rui, Long Cui, Hongzhong Wang et al.CVPR 2024 · 32 citations
- Iterative Denoiser and Noise Estimator for Self-Supervised Image DenoisingYunhao Zou, Chenggang Yan, Ying FuICCV 2023 · 30 citations
- Unmixing Diffusion for Self-Supervised Hyperspectral Image DenoisingHaijin Zeng, Jiezhang Cao, Kai Zhang, Yongyong Chen et al.CVPR 2024 · 23 citations
Builds on5
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Attention is not all you need: pure attention loses rank doubly exponentially with depthYihe Dong, Jean-Baptiste Cordonnier, Andreas LoukasICML 2021 · 522 citations
- Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image ReconstructionYuanhao Cai, Jing Lin, Xiaowan Hu, Haoqian Wang et al.CVPR 2022 · 310 citations
- UP-DETR: Unsupervised Pre-Training for Object Detection With TransformersZhigang Dai, Bolun Cai, Yugeng Lin, Junying ChenCVPR 2021
Related papers
- Spectral Enhanced Rectangle Transformer for Hyperspectral Image DenoisingMiaoyu Li, Ji Liu, Ying Fu, Yulun Zhang et al.CVPR 2023
- VolFormer: Explore More Comprehensive Cube Interaction for Hyperspectral Image Restoration and BeyondDabing Yu, Zheng GaoCVPR 2025
- Improving Spectral Snapshot Reconstruction with Spectral-Spatial RectificationJiancheng Zhang, Haijin Zeng, Yongyong Chen, Dengxiu Yu et al.CVPR 2024 · 10 citations
- Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image ReconstructionMiaoyu Li, Ying Fu, Ji Liu, Yulun ZhangICCV 2023 · 74 citations
- HyperTransformer: A Textural and Spectral Feature Fusion Transformer for PansharpeningWele Gedara Chaminda Bandara, Vishal M. PatelCVPR 2022 · 175 citations
