A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restoration
Théo Bodrito, Alexandre Zouaoui, Jocelyn Chanussot, Julien Mairal
Abstract
Hyperspectral imaging offers new perspectives for diverse applications, ranging from the monitoring of the environment using airborne or satellite remote sensing, precision farming, food safety, planetary exploration, or astrophysics. Unfortunately, the spectral diversity of information comes at the expense of various sources of degradation, and the lack of accurate ground-truth "clean" hyperspectral signals acquired on the spot makes restoration tasks challenging. In particular, training deep neural networks for restoration is difficult, in contrast to traditional RGB imaging problems where deep models tend to shine. In this paper, we advocate instead for a hybrid approach based on sparse coding principles that retains the interpretability of classical techniques encoding domain knowledge with handcrafted image priors, while allowing to train model parameters end-to-end without massive amounts of data. We show on various denoising benchmarks that our method is computationally efficient and significantly outperforms the state of the art. 1 * Equal contribution 1 Code is available at https://github.com/inria-thoth/T3SC . 35th Conference on Neural Information Processing Systems (NeurIPS 2021).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f17d7dd7-86aa-4284-a9ec-896b83eaea8bCited by top-tier papers10
- Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image ReconstructionMiaoyu Li, Ying Fu, Ji Liu, Yulun ZhangICCV 2023 · 74 citations
- DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image RestorationYuchun Miao, Lefei Zhang, Liangpei Zhang, Dacheng TaoICCV 2023 · 64 citations
- Hybrid Spectral Denoising Transformer with Guided AttentionZeqiang Lai, Chenggang Yan, Ying FuICCV 2023 · 35 citations
- HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion ModelsLi Pang, Xiangyu Rui, Long Cui, Hongzhong Wang et al.CVPR 2024 · 32 citations
- Unmixing Diffusion for Self-Supervised Hyperspectral Image DenoisingHaijin Zeng, Jiezhang Cao, Kai Zhang, Yongyong Chen et al.CVPR 2024 · 23 citations
Related papers
- Hyperspectral Image Reconstruction Using Deep External and Internal LearningTao Zhang, Ying Fu, Lizhi Wang, Hua HuangICCV 2019 · 64 citations
- Self-supervised Neural Networks for Spectral Snapshot Compressive ImagingZiyi Meng, Zhenming Yu, Kun Xu, Xin YuanICCV 2021 · 120 citations
- Learning an Explicit Weighting Scheme for Adapting Complex HSI NoiseXiangyu Rui, Xiangyong Cao, Qi Xie, Zongsheng Yue et al.CVPR 2021
- Semantic-embedded Unsupervised Spectral Reconstruction from Single RGB Images in the WildZhiyu Zhu, Hui Liu, Junhui Hou, Huanqiang Zeng et al.ICCV 2021 · 27 citations
- DNU: Deep Non-Local Unrolling for Computational Spectral ImagingLizhi Wang, Chen Sun, Maoqing Zhang, Ying Fu et al.CVPR 2020
