DeAltHDR: Learning HDR Video Reconstruction from Degraded Alternating Exposure Sequences
Shuohao Zhang, Zhilu Zhang, Rongjian Xu, Xiaohe Wu, Wangmeng Zuo
摘要
High dynamic range (HDR) video can be reconstructed from low dynamic range (LDR) sequences with alternating exposures. However, most existing methods overlook the degradations (e.g., noise and blur) in LDR frames, focusing only on the brightness and position differences between them. To address this gap, we propose DeAltHDR, a novel framework for high-quality HDR video reconstruction from degraded sequences. Our framework addresses two key challenges. First, noisy and blurry content complicate inter-frame alignment. To tackle this, we propose a flow-guided masked attention mechanism that leverages optical flow for a dynamic sparse cross-attention computation, achieving superior performance while maintaining efficiency. Notably, its controllable attention ratio allows for adaptive inference costs. Second, the lack of real-world paired data hinders practical deployment. We overcome this with a two-stage training paradigm: the model is first pre-trained on our newly introduced synthetic paired dataset and subsequently fine-tuned on unlabeled real-world videos via a proposed self-supervised method. Experiments show our method outperforms state-of-theart ones. Code and data will be available at https://zhang-shuohao. github.io/DeAltHDR/ .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Exploring CLIP for Assessing the Look and Feel of ImagesJianyi Wang, Kelvin C. K. Chan, Chen Change LoyAAAI 2023 · 被引用 1,208 次
- BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and AlignmentKelvin C. K. Chan, Shangchen Zhou, Xiangyu Xu, Chen Change LoyCVPR 2022 · 被引用 522 次
- Recurrent Video Restoration Transformer with Guided Deformable AttentionJingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan 等NeurIPS 2022 · 被引用 318 次
- Learning temporal coherence via self-supervision for GAN-based video generationMengyu Chu, You Xie, Jonas Mayer, Laura Leal-Taixé 等SIGGRAPH 2020 · 被引用 198 次
- Rethinking Alignment in Video Super-Resolution TransformersShuwei Shi, Jinjin Gu, Liangbin Xie, Xintao Wang 等NeurIPS 2022 · 被引用 134 次
相关 Paper
- HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark DatasetGuanying Chen, Chaofeng Chen, Shi Guo, Zhetong Liang 等ICCV 2021 · 被引用 70 次
- F^2HDR: Two-Stage HDR Video Reconstruction via Flow Adapter and Physical Motion ModelingHuanjing Yue, Dawei Li, Shaoxiong Tu, Jingyu YangCVPR 2026
- HDRFlow: Real-Time HDR Video Reconstruction with Large MotionsGangwei Xu, Yujin Wang, Jinwei Gu, Tianfan Xue 等CVPR 2024 · 被引用 12 次
- LAN-HDR: Luminance-based Alignment Network for High Dynamic Range Video ReconstructionHaesoo Chung, Nam Ik ChoICCV 2023 · 被引用 20 次
- Exposure Completing for Temporally Consistent Neural High Dynamic Range Video RenderingJiahao Cui, Wei Jiang, Zhan Peng, Zhiyu Pan 等ACM MM 2024 · 被引用 3 次
