Deep Gaussian Scale Mixture Prior for Spectral Compressive Imaging
Tao Huang, Weisheng Dong, Xin Yuan, Jinjian Wu, Guangming Shi
Abstract
In coded aperture snapshot spectral imaging (CASSI) system, the real-world hyperspectral image (HSI) can be reconstructed from the captured compressive image in a snapshot. Model-based HSI reconstruction methods employed hand-crafted priors to solve the reconstruction problem, but most of which achieved limited success due to the poor representation capability of these hand-crafted priors. Deep learning based methods learning the mappings between the compressive images and the HSIs directly achieved much better results. Yet, it is nontrivial to design a powerful deep network heuristically for achieving satisfied results. In this paper, we propose a novel HSI reconstruction method based on the Maximum a Posterior (MAP) estimation framework using learned Gaussian Scale Mixture (GSM) prior. Different from existing GSM models using hand-crafted scale priors (e.g., the Jeffrey's prior), we propose to learn the scale prior through a deep convolutional neural network (DCNN). Furthermore, we also propose to estimate the local means of the GSM models by the DCNN. All the parameters of the MAP estimation algorithm and the DCNN parameters are jointly optimized through end-to-end training. Extensive experimental results on both synthetic and real datasets demonstrate that the proposed method outperforms existing state-of-the-art methods. The code is available at https://see.xidian.edu.cn/faculty/ wsdong/Projects/DGSM-SCI.htm.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf5f0a93-fe7c-4068-8780-a88d4c3b1d89Cited by top-tier papers26
- Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image ReconstructionYuanhao Cai, Jing Lin, Xiaowan Hu, Haoqian Wang et al.CVPR 2022 · 310 citations
- Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive ImagingYuanhao Cai, Jing Lin, Haoqian Wang, Xin Yuan et al.NeurIPS 2022 · 222 citations
- HDNet: High-resolution Dual-domain Learning for Spectral Compressive ImagingXiaowan Hu, Yuanhao Cai, Jing Lin, Haoqian Wang et al.CVPR 2022 · 193 citations
- Self-supervised Neural Networks for Spectral Snapshot Compressive ImagingZiyi Meng, Zhenming Yu, Kun Xu, Xin YuanICCV 2021 · 120 citations
- Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image ReconstructionMiaoyu Li, Ying Fu, Ji Liu, Yulun ZhangICCV 2023 · 74 citations
Builds on4
- Computational Hyperspectral Imaging Based on Dimension-Discriminative Low-Rank Tensor RecoveryShipeng Zhang, Lizhi Wang, Ying Fu, Xiaoming Zhong et al.ICCV 2019 · 82 citations
- Spatial-Temporal Gaussian Scale Mixture Modeling for Foreground EstimationQian Ning, Weisheng Dong, Fangfang Wu, Jinjian Wu et al.AAAI 2020 · 12 citations
- DNU: Deep Non-Local Unrolling for Computational Spectral ImagingLizhi Wang, Chen Sun, Maoqing Zhang, Ying Fu et al.CVPR 2020
- Plug-and-Play Algorithms for Large-Scale Snapshot Compressive ImagingXin Yuan, Yang Liu, Jin-Li Suo, Qionghai DaiCVPR 2020
Related papers
- Hyperspectral Image Reconstruction Using Deep External and Internal LearningTao Zhang, Ying Fu, Lizhi Wang, Hua HuangICCV 2019 · 64 citations
- Dual-Window Multiscale Transformer for Hyperspectral Snapshot Compressive ImagingFulin Luo, Xi Chen, Xiuwen Gong, Weiwen Wu et al.AAAI 2024 · 19 citations
- Residual Degradation Learning Unfolding Framework with Mixing Priors Across Spectral and Spatial for Compressive Spectral ImagingYubo Dong, Dahua Gao, Tian Qiu, Yuyan Li et al.CVPR 2023
- Bridging Local–Global Dissonance: Learning from Compressive Measurements for Hyperspectral ReconstructionXian-Hua HanICML 2026
- Spectral Compressive Imaging via Chromaticity-Intensity DecompositionXiaodong Wang, Zijun He, Ping Wang, Lishun Wang et al.NeurIPS 2025 · 4 citations
