Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Spectral Super-Resolution for Snapshot Compressive Imaging
Wudi Chen, Zhiyuan Zha, Xin Yuan, Shigang Wang, Bihan Wen, Jiantao Zhou, Gang Yan, zipei fan, Ce Zhu
摘要
Recent advances have demonstrated that coded aperture snapshot spectral imaging (CASSI) systems show great potential for capturing 3D hyperspectral images (HSIs) from a single 2D measurement. Despite the inherent spectral continuity of scenes captured by CASSI, most existing reconstruction methods are restricted to fixed, discrete spectral outputs, thereby precluding continuous spectral reconstruction or spectral super-resolution. To address this challenge, we propose Phy-CoSF, which synergizes deep unfolding networks with implicit neural representations, establishing a new paradigm for continuous spectral reconstruction and super-resolution in CASSI. Specifically, we propose a two-phase architecture that bridges discrete-wavelength training with continuous spectral rendering, enabling the synthesis of high-fidelity HSIs at arbitrary target wavelengths. At the core of our framework lies the continuous spectral fields (CoSF) module, embedded within each unfolding stage as a dynamic prior, which comprises a triple-branch cross-domain feature mixer for comprehensive spatial–frequency–channel feature fusion, alongside a spectral synthesis head that generates spectral intensities by querying continuous wavelength coordinates. Extensive experimental results demonstrate that Phy-CoSF not only achieves continuous modeling at arbitrary spectral resolutions but also outperforms many state-of-the-art methods in both reconstruction fidelity and spectral detail preservation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang 等ICML 2024 · 被引用 1,725 次
- Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive ImagingYuanhao Cai, Jing Lin, Haoqian Wang, Xin Yuan 等NeurIPS 2022 · 被引用 222 次
- Deep Tensor ADMM-Net for Snapshot Compressive ImagingJiawei Ma, Xiao-Yang Liu, Zheng Shou, Xin YuanICCV 2019 · 被引用 218 次
- HDNet: High-resolution Dual-domain Learning for Spectral Compressive ImagingXiaowan Hu, Yuanhao Cai, Jing Lin, Haoqian Wang 等CVPR 2022 · 被引用 193 次
- Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image ReconstructionMiaoyu Li, Ying Fu, Ji Liu, Yulun ZhangICCV 2023 · 被引用 74 次
相关 Paper
- Residual Degradation Learning Unfolding Framework with Mixing Priors Across Spectral and Spatial for Compressive Spectral ImagingYubo Dong, Dahua Gao, Tian Qiu, Yuyan Li 等CVPR 2023
- VmambaSCI: Dynamic Deep Unfolding Network with Mamba for Compressive Spectral ImagingMingjin Zhang, Longyi Li, Wenxuan Shi, Jie Guo 等ACM MM 2024 · 被引用 13 次
- Joint Spectral Image Reconstruction and Semantic Segmentation with Cooperative UnfoldingZijun He, Ping Wang, Xiaodong Wang, Chang Chen 等CVPR 2026
- Spectral Compressive Imaging via Chromaticity-Intensity DecompositionXiaodong Wang, Zijun He, Ping Wang, Lishun Wang 等NeurIPS 2025 · 被引用 4 次
- Detail Matters: Mamba-Inspired Joint Unfolding Network for Snapshot Spectral Compressive ImagingMengjie Qin, Yuchao Feng, Zongliang Wu, Yulun Zhang 等AAAI 2025 · 被引用 21 次
