Robust Unfolding Network for HDR Imaging with Modulo Cameras
Zhile Chen, Hui Ji
Abstract
High Dynamic Range (HDR) imaging with modulo cameras involves solving a challenging inverse problem, where degradation occurs due to the modulo operation applied to the target HDR image. Existing methods operate directly in the image domain, overlooking the underlying properties of the modulo operation. Motivated by Itoh's continuity condition in optics, we reformulate modulo HDR reconstruction in image gradient domain, leveraging the inherent properties of modulo-wrapped gradients to simplify the problem. Furthermore, to address possible ambiguities on large image gradients, we introduce an auxiliary variable with a learnable sparsity prior in an optimization formulation to absorb the related residuals. This is implemented within an unfolding network, where sparsity is enforced through a spiking neuron-based module. Experiments show that our method outperforms existing approaches while being among the lightest models of existing works.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext faae5636-5e3a-42e5-bd81-61a253f65e8bCited by top-tier papers1
Ask how each one uses itBuilds on13
- Uformer: A General U-Shaped Transformer for Image RestorationZhendong Wang, Xiaodong Cun, Jianmin Bao, Wengang Zhou et al.CVPR 2022 · 1,970 citations
- Single image HDR reconstruction using a CNN with masked features and perceptual lossMarcel Santana Santos, Tsang Ing Ren, Nima Khademi KalantariSIGGRAPH 2020 · 144 citations
- LTMD: Learning Improvement of Spiking Neural Networks with Learnable Thresholding Neurons and Moderate DropoutSiqi Wang, Tee Hiang Cheng, Meng-Hiot LimNeurIPS 2022 · 57 citations
- Alignment-free HDR Deghosting with Semantics Consistent TransformerSteven Tel, Zongwei Wu, Yulun Zhang, Barthélémy Heyrman et al.ICCV 2023 · 44 citations
- Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral LearningZhuoran Zheng, Wenqi Ren, Xiaochun Cao, Tao Wang et al.ICCV 2021 · 40 citations
Related papers
- UnModNet: Learning to Unwrap a Modulo Image for High Dynamic Range ImagingChu Zhou, Hang Zhao, Jin Han, Chang Xu et al.NeurIPS 2020 · 26 citations
- Neuromorphic Camera Guided High Dynamic Range ImagingJin Han, Chu Zhou, Peiqi Duan, Yehui Tang et al.CVPR 2020
- Single-Image HDR Reconstruction by Learning to Reverse the Camera PipelineYu-Lun Liu, Wei-Sheng Lai, Yu-Sheng Chen, Yi-Lung Kao et al.CVPR 2020
- Learning Rank-1 Diffractive Optics for Single-Shot High Dynamic Range ImagingQilin Sun, Ethan Tseng, Qiang Fu, Wolfgang Heidrich et al.CVPR 2020
- 1000 FPS HDR Video with a Spike-RGB Hybrid CameraYakun Chang, Chu Zhou, Yuchen Hong, Liwen Hu et al.CVPR 2023
