Normal-NeRF: Ambiguity-Robust Normal Estimation for Highly Reflective Scenes
Ji Shi, Xianghua Ying, Ruohao Guo, Bowei Xing, Wenzhen Yue
Abstract
Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular reflections. However, the robust reconstruction of highly reflective scenes is still hindered by the inherent shape ambiguity on specular surfaces. Existing methods typically rely on additional geometry priors to regularize the shape prediction, but this can lead to oversmoothed geometry in complex scenes. Observing the critical role of surface normals in parameterizing reflections, we introduce a transmittance-gradient-based normal estimation technique that remains robust even under ambiguous shape conditions. Furthermore, we propose a dual activated densities module that effectively bridges the gap between smooth surface normals and sharp object boundaries. Combined with a reflection-aware appearance model, our proposed method achieves robust reconstruction and high-fidelity rendering of scenes featuring both highly specular reflections and intricate geometric structures. Extensive experiments demonstrate that our method outperforms existing state-of-the-art methods on various datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6e1098b8-c0d5-4b36-93ca-a8059005024fCited by top-tier papers1
Ask how each one uses itBuilds on28
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
Related papers
- Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance FieldsDor Verbin, Peter Hedman, Ben Mildenhall, Todd E. Zickler et al.CVPR 2022 · 477 citations
- NeRFReN: Neural Radiance Fields with ReflectionsYuan-Chen Guo, Di Kang, Linchao Bao, Yu He et al.CVPR 2022 · 124 citations
- Reducing Shape-Radiance Ambiguity in Radiance Fields with a Closed-Form Color Estimation MethodQihang Fang, Yafei Song, Keqiang Li, Liefeng BoNeurIPS 2023 · 8 citations
- Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance ModelingLiwen Wu, Sai Bi, Zexiang Xu, Fujun Luan et al.CVPR 2024 · 10 citations
- Neural Transmitted Radiance FieldsChengxuan Zhu, Renjie Wan, Boxin ShiNeurIPS 2022 · 24 citations
