HFR and HDR Video from Multi-Attenuated Spikes Using a Rapidly Rotating SpokeND Filter
Yakun Chang, Zhaojun Huang, Siqi Yang, Yeliduosi Xiaokaiti, Shikui Wei, Yao Zhao, Tiejun Huang, Boxin Shi
摘要
Capturing scenes with both high dynamic range (HDR) and high-speed motion remains challenging for conventional cameras. Existing alternating-exposure approaches exacerbate temporal resolution loss, making them unsuitable for high-speed scenes. Consequently, current solutions typically fix spatial-varying attenuation levels or employ multiple sensors to maintain temporal resolution. In this paper, we leverage an ultra-high speed spike camera to enable spatial and temporal attenuation of incident light, thereby reconstructing high-frame-rate (HFR) and HDR video with a single sensor. We achieve this by placing a rapidly rotating spoke-pattern neutral density (SpokeND) filter in front of the camera, enabling each pixel to periodically capture multi-attenuated spikes. Building on these multi-attenuated spikes, we propose ReST-Net, which comprises the ReGain and ReFine modules. The ReGain module reconstructs spatially consistent frames by learning to recover relative gain from the multi-attenuated spikes, and the ReFine module removes temporal fluctuations to produce temporally consistent HDR videos. Extensive experiments on synthetic and real-world data demonstrate that our method can reconstruct HDR video at up to 2000 FPS.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark DatasetGuanying Chen, Chaofeng Chen, Shi Guo, Zhetong Liang 等ICCV 2021 · 被引用 70 次
- Optical Flow Estimation for Spiking CameraLiwen Hu, Rui Zhao, Ziluo Ding, Lei Ma 等CVPR 2022 · 被引用 48 次
- Self-Supervised Joint Dynamic Scene Reconstruction and Optical Flow Estimation for Spiking CameraShiyan Chen, Zhaofei Yu, Tiejun HuangAAAI 2023 · 被引用 22 次
- Learning to Super-resolve Dynamic Scenes for Neuromorphic Spike CameraJing Zhao, Ruiqin Xiong, Jian Zhang, Rui Zhao 等AAAI 2023 · 被引用 21 次
- Joint Demosaicing and Denoising for Spike CameraYanchen Dong, Ruiqin Xiong, Jing Zhao, Jian Zhang 等AAAI 2024 · 被引用 18 次
相关 Paper
- 1000 FPS HDR Video with a Spike-RGB Hybrid CameraYakun Chang, Chu Zhou, Yuchen Hong, Liwen Hu 等CVPR 2023
- Towards HDR and HFR Video from Rolling-Mixed-Bit SpikingsYakun Chang, Yeliduosi Xiaokaiti, Yujia Liu, Bin Fan 等CVPR 2024
- Super Resolve Dynamic Scene from Continuous Spike StreamsJing Zhao, Jiyu Xie, Ruiqin Xiong, Jian Zhang 等ICCV 2021 · 被引用 42 次
- BulletTime4D: Towards High Spatio-Temporal Resolution Dynamic Scene Rendering via Spike-Guided Stereo VisionYiqian Chang, Haoran Xu, Qinghong Ye, Jianing Li 等AAAI 2026
- Spk2ImgNet: Learning To Reconstruct Dynamic Scene From Continuous Spike StreamJing Zhao, Ruiqin Xiong, Hangfan Liu, Jian Zhang 等CVPR 2021
