Semi-Supervised High Dynamic Range Image Reconstructing via Bi-Level Uncertain Area Masking
Wei Jiang, Jiahao Cui, Yizheng Wu, Zhan Peng, Zhiyu Pan, Zhiguo Cao
Abstract
Reconstructing high dynamic range (HDR) images from low dynamic range (LDR) bursts plays an essential role in the computational photography. Impressive progress has been achieved by learning-based algorithms which require LDR-HDR image pairs. However, these pairs are hard to obtain, which motivates researchers to delve into the problem of annotation-efficient HDR image reconstructing: how to achieve comparable performance with limited HDR ground truths (GTs). This work attempts to address this problem from the view of semi-supervised learning where a teacher model generates pseudo HDR GTs for the LDR samples without GTs and a student model learns from pseudo GTs. Nevertheless, the confirmation bias, i.e., the student may learn from the artifacts in pseudo HDR GTs, presents an impediment. To remove this impediment, an uncertainty-based masking process is proposed to discard unreliable parts of pseudo GTs at both pixel and patch levels, then the trusted areas can be learned from by the student. With this novel masking process, our semi-supervised HDR reconstructing method not only outperforms previous annotation-efficient algorithms, but also achieves comparable performance with up-to-date fully-supervised methods by using only 6.7% HDR GTs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 068c7f70-a5ac-4d6a-be6a-c9f7ee51ae61Builds on11
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based DetectorsYen-Cheng Liu, Chih-Yao Ma, Zsolt KiraCVPR 2022 · 124 citations
- Label Matching Semi-Supervised Object DetectionBinbin Chen, Weijie Chen, Shicai Yang, Yunyi Xuan et al.CVPR 2022 · 87 citations
- UCC: Uncertainty guided Cross-head Cotraining for Semi-Supervised Semantic SegmentationJiashuo Fan, Bin Gao, Huan Jin, Lihui JiangCVPR 2022 · 77 citations
- Alignment-free HDR Deghosting with Semantics Consistent TransformerSteven Tel, Zongwei Wu, Yulun Zhang, Barthélémy Heyrman et al.ICCV 2023 · 44 citations
Related papers
- SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked AutoencodersQingsen Yan, Song Zhang, Weiye Chen, Hao Tang et al.CVPR 2023
- Single image HDR reconstruction using a CNN with masked features and perceptual lossMarcel Santana Santos, Tsang Ing Ren, Nima Khademi KalantariSIGGRAPH 2020 · 144 citations
- Labeled From Unlabeled: Exploiting Unlabeled Data for Few-Shot Deep HDR DeghostingK. Ram Prabhakar, Gowtham Senthil, Susmit Agrawal, R. Venkatesh Babu et al.CVPR 2021
- Single-Image HDR Reconstruction by Learning to Reverse the Camera PipelineYu-Lun Liu, Wei-Sheng Lai, Yu-Sheng Chen, Yi-Lung Kao et al.CVPR 2020
- RawHDR: High Dynamic Range Image Reconstruction from a Single Raw ImageYunhao Zou, Chenggang Yan, Ying FuICCV 2023 · 36 citations
