DeAltHDR: Learning HDR Video Reconstruction from Degraded Alternating Exposure Sequences
Shuohao Zhang, Zhilu Zhang, Rongjian Xu, Xiaohe Wu, Wangmeng Zuo
Abstract
High dynamic range (HDR) video can be reconstructed from low dynamic range (LDR) sequences with alternating exposures. However, most existing methods overlook the degradations (e.g., noise and blur) in LDR frames, focusing only on the brightness and position differences between them. To address this gap, we propose DeAltHDR, a novel framework for high-quality HDR video reconstruction from degraded sequences. Our framework addresses two key challenges. First, noisy and blurry content complicate inter-frame alignment. To tackle this, we propose a flow-guided masked attention mechanism that leverages optical flow for a dynamic sparse cross-attention computation, achieving superior performance while maintaining efficiency. Notably, its controllable attention ratio allows for adaptive inference costs. Second, the lack of real-world paired data hinders practical deployment. We overcome this with a two-stage training paradigm: the model is first pre-trained on our newly introduced synthetic paired dataset and subsequently fine-tuned on unlabeled real-world videos via a proposed self-supervised method. Experiments show our method outperforms state-of-theart ones. Code and data will be available at https://zhang-shuohao. github.io/DeAltHDR/ .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3ed86c64-75f7-4871-8bdb-dc8353a6e21aBuilds on18
- Exploring CLIP for Assessing the Look and Feel of ImagesJianyi Wang, Kelvin C. K. Chan, Chen Change LoyAAAI 2023 · 1,208 citations
- BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and AlignmentKelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu, Chen Change LoyCVPR 2022 · 522 citations
- Recurrent Video Restoration Transformer with Guided Deformable AttentionJingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan et al.NeurIPS 2022 · 318 citations
- Learning temporal coherence via self-supervision for GAN-based video generationMengyu Chu, You Xie, Jonas Mayer, Laura Leal-Taixé et al.SIGGRAPH 2020 · 198 citations
- Rethinking Alignment in Video Super-Resolution TransformersShuwei Shi, Jinjin Gu, Liangbin Xie, Xintao Wang et al.NeurIPS 2022 · 134 citations
Related papers
- HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark DatasetGuanying Chen, Chaofeng Chen, Shi Guo, Zhetong Liang et al.ICCV 2021 · 70 citations
- F^2HDR: Two-Stage HDR Video Reconstruction via Flow Adapter and Physical Motion ModelingHuanjing Yue, Dawei Li, Shaoxiong Tu, Jingyu YangCVPR 2026
- HDRFlow: Real-Time HDR Video Reconstruction with Large MotionsGangwei Xu, Yujin Wang, Jinwei Gu, Tianfan Xue et al.CVPR 2024 · 12 citations
- LAN-HDR: Luminance-based Alignment Network for High Dynamic Range Video ReconstructionHaesoo Chung, Nam Ik ChoICCV 2023 · 20 citations
- Exposure Completing for Temporally Consistent Neural High Dynamic Range Video RenderingJiahao Cui, Wei Jiang, Zhan Peng, Zhiyu Pan et al.ACM MM 2024 · 3 citations
