Bright-NeRF: Brightening Neural Radiance Field with Color Restoration from Low-Light RAW Images
Min Wang, Xin Huang, Guoqing Zhou, Qifeng Guo, Qing Wang
Abstract
Neural Radiance Fields (NeRFs) have demonstrated prominent performance in novel view synthesis. However, their input heavily relies on image acquisition under normal light conditions, making it challenging to learn accurate scene representation in low-light environments where images typically exhibit significant noise and severe color distortion. To address these challenges, we propose a novel approach, Bright-NeRF, which learns enhanced and high-quality radiance fields from multi-view low-light raw images in an unsupervised manner. Our method simultaneously achieves color restoration, denoising, and enhanced novel view synthesis. Specifically, we leverage a physically-inspired model of the sensor's response to illumination and introduce a chromatic adaptation loss to constrain the learning of response, enabling consistent color perception of objects regardless of lighting conditions. We further utilize the raw data's properties to expose the scene's intensity automatically. Additionally, we have collected a multi-view low-light raw image dataset to advance research in this field. Experimental results demonstrate that our proposed method significantly outperforms existing 2D and 3D approaches. Our code and dataset will be made publicly available.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on19
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Toward Fast, Flexible, and Robust Low-Light Image EnhancementLong Ma, Tengyu Ma, Risheng Liu, Xin Fan et al.CVPR 2022 · 928 citations
- NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw ImagesBen Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul P. Srinivasan et al.CVPR 2022 · 307 citations
- EEMEFN: Low-Light Image Enhancement via Edge-Enhanced Multi-Exposure Fusion NetworkMinfeng Zhu, Pingbo Pan, Wei Chen, Yi YangAAAI 2020 · 232 citations
Related papers
- Lighting up NeRF via Unsupervised Decomposition and EnhancementHaoyuan Wang, Xiaogang Xu, Ke Xu, Rynson W. H. LauICCV 2023 · 55 citations
- Enhancing Neural Radiance Fields with Adaptive Multi-Exposure Fusion: A Bilevel Optimization Approach for Novel View SynthesisYang Zou, Xingyuan Li, Zhiying Jiang, Jinyuan LiuAAAI 2024 · 20 citations
- NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo CollectionsRicardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron et al.CVPR 2021
- LuSh-NeRF: Lighting up and Sharpening NeRFs for Low-light ScenesZefan Qu, Ke Xu, Gerhard P. Hancke, Rynson W. H. LauNeurIPS 2024 · 19 citations
- SPARF: Neural Radiance Fields from Sparse and Noisy PosesPrune Truong, Marie-Julie Rakotosaona, Fabian Manhardt, Federico TombariCVPR 2023
