Aperture Diffraction for Compact Snapshot Spectral Imaging
Tao Lv, Hao Ye, Quan Yuan, Zhan Shi, Yibo Wang, Shuming Wang, Xun Cao
Abstract
We demonstrate a compact, cost-effective snapshot spectral imaging system named Aperture Diffraction Imaging Spectrometer (ADIS), which consists only of an imaging lens with an ultra-thin orthogonal aperture mask and a mosaic filter sensor, requiring no additional physical footprint compared to common RGB cameras. Then we introduce a new optical design that each point in the object space is multiplexed to discrete encoding locations on the mosaic filter sensor by diffraction-based spatial-spectral projection engineering generated from the orthogonal mask. The orthogonal projection is uniformly accepted to obtain a weakly calibration-dependent data form to enhance modulation robustness. Meanwhile, the Cascade Shift-Shuffle Spectral Transformer (CSST) with strong perception of the diffraction degeneration is designed to solve a sparsity-constrained inverse problem, realizing the volume reconstruction from 2D measurements with Large amount of aliasing. Our system is evaluated by elaborating the imaging optical theory and reconstruction algorithm with demonstrating the experimental imaging under a single exposure. Ultimately, we achieve the sub-super-pixel spatial resolution and high spectral resolution imaging. The code will be available at: https://github.com/Krito-ex/CSST .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging cites Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction
- Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction cites HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
- Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging cites HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
- Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging cites Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction
Builds on8
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image ReconstructionYuanhao Cai, Jing Lin, Xiaowan Hu, Haoqian Wang et al.CVPR 2022 · 310 citations
- Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive ImagingYuanhao Cai, Jing Lin, Haoqian Wang, Xin Yuan et al.NeurIPS 2022 · 222 citations
- HDNet: High-resolution Dual-domain Learning for Spectral Compressive ImagingXiaowan Hu, Yuanhao Cai, Jing Lin, Haoqian Wang et al.CVPR 2022 · 193 citations
- When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention MechanismGuangting Wang, Yucheng Zhao, Chuanxin Tang, Chong Luo et al.AAAI 2022 · 92 citations
Related papers
- Spectral Compressive Imaging via Chromaticity-Intensity DecompositionXiaodong Wang, Zijun He, Ping Wang, Lishun Wang et al.NeurIPS 2025 · 4 citations
- VmambaSCI: Dynamic Deep Unfolding Network with Mamba for Compressive Spectral ImagingMingjin Zhang, Longyi Li, Wenxuan Shi, Jie Guo et al.ACM MM 2024 · 13 citations
- Residual Degradation Learning Unfolding Framework with Mixing Priors Across Spectral and Spatial for Compressive Spectral ImagingYubo Dong, Dahua Gao, Tian Qiu, Yuyan Li et al.CVPR 2023
- Dual-Window Multiscale Transformer for Hyperspectral Snapshot Compressive ImagingFulin Luo, Xi Chen, Xiuwen Gong, Weiwen Wu et al.AAAI 2024 · 19 citations
- ChromaFlash: Snapshot Hyperspectral Imaging Using Rolling Shutter CamerasDhruv Verma, Ian Ruffolo, David B. Lindell, Kiriakos N. Kutulakos et al.UbiComp 2024 · 4 citations
