NEC-Diff: Noise-Robust Event-RAW Complementary Diffusion for Seeing Motion in Extreme Darkness
Haoyue Liu, Jinghan Xu, Luxin Feng, Hanyu Zhou, Haozhi Zhao, Yi Chang, Luxin Yan
Abstract
High-quality imaging of dynamic scenes in extremely low-light conditions is highly challenging. Photon scarcity induces severe noise and texture loss, causing significant image degradation. Event cameras, featuring a high dynamic range (120 dB) and high sensitivity to motion, serve as powerful complements to conventional cameras by offering crucial cues for preserving subtle textures. However, most existing approaches emphasize texture recovery from events, while paying little attention to image noise or the intrinsic noise of events themselves, which ultimately hinders accurate pixel reconstruction under photon-starved conditions. In this work, we propose NEC-Diff, a novel diffusion-based event-RAW hybrid imaging framework that extracts reliable information from heavily noisy signals to reconstruct fine scene structures. The framework is driven by two key insights: (1) combining the linear light-response property of RAW images with the brightness-change nature of events to establish a physics-driven constraint for robust dual-modal denoising; and (2) dynamically estimating the SNR of both modalities based on denoising results to guide adaptive feature fusion, thereby injecting reliable cues into the diffusion process for high-fidelity visual reconstruction. Furthermore, we construct the REAL (Raw and Event Acquired in Low-light) dataset which provides 47,800 pixel-aligned low-light RAW images, events, and high-quality references under 0.001-0.8 lux illumination. Extensive experiments demonstrate the superiority of NEC-Diff under extreme darkness. The project are available at: https://github.com/jinghan-xu/NEC-Diff.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on32
- Toward Fast, Flexible, and Robust Low-Light Image EnhancementLong Ma, Tengyu Ma, Risheng Liu, Xin Fan et al.CVPR 2022 · 928 citations
- URetinex-Net: Retinex-based Deep Unfolding Network for Low-light Image EnhancementWenhui Wu, Jian Weng, Pingping Zhang, Xu Wang et al.CVPR 2022 · 695 citations
- Retinexformer: One-stage Retinex-based Transformer for Low-light Image EnhancementYuanhao Cai, Hao Bian, Jing Lin, Haoqian Wang et al.ICCV 2023 · 615 citations
- SNR-Aware Low-light Image EnhancementXiaogang Xu, Ruixing Wang, Chi-Wing Fu, Jiaya JiaCVPR 2022 · 552 citations
- Seeing Motion in the DarkChen Chen, Qifeng Chen, Minh N. Do, Vladlen KoltunICCV 2019 · 315 citations
Related papers
- Coherent Event Guided Low-Light Video EnhancementJinxiu Liang, Yixin Yang, Boyu Li, Peiqi Duan et al.ICCV 2023 · 54 citations
- Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging ScenesHaonan Wang, Hanyu Zhou, Haoyue Liu, Luxin YanNeurIPS 2025 · 4 citations
- Event-Guided Consistent Video Enhancement with Modality-Adaptive Diffusion PipelineKanghao Chen, Zixin Zhang, Guoqiang Liang, Lutao Jiang et al.NeurIPS 2025 · 2 citations
- From Events to Clarity: The Event-Guided Diffusion Framework for DehazingLing Wang, Yunfan Lu, Wenzong Ma, Huizai Yao et al.CVPR 2026
- LED: A Large-scale Real-world Paired Dataset for Event Camera DenoisingYuxing DuanCVPR 2024
