RobIR: Robust Inverse Rendering for High-Illumination Scenes
Ziyi Yang, Chenyanzhen, Xinyu Gao, Yazhen Yuan, Yu Wu, Xiaowei Zhou, Xiaogang Jin
Abstract
Implicit representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and slight reflections. The existence of shadows and reflections can lead to an inaccurate understanding of the scene, making precise factorization difficult. To this end, we present RobIR , an implicit inverse rendering approach that uses ACES tone mapping and regularized visibility estimation to reconstruct accurate BRDF of the object. By accurately modeling the indirect radiance field, normal, visibility, and direct light simultaneously, we are able to accurately decouple environment lighting and the object’s PBR materials without imposing strict constraints on the scene. Even in high-illumination scenes with shadows and specular reflections, our method can recover high-quality albedo and roughness with no shadow interference. RobIR outperforms existing methods in both quantitative and qualitative evaluations. Code is available at https://github.com/ingra14m/RobIR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on35
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- PlenOctrees for Real-time Rendering of Neural Radiance FieldsAlex Yu, Ruilong Li, Matthew Tancik, Hao Li et al.ICCV 2021 · 1,284 citations
Related papers
- Modeling Indirect Illumination for Inverse RenderingYuanqing Zhang, Jiaming Sun, Xingyi He, Huan Fu et al.CVPR 2022 · 140 citations
- Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy ObjectsYue Fan, Ningjing Fan, Ivan Skorokhodov, Oleg Voynov et al.CVPR 2025
- Neural Multi-View Self-Calibrated Photometric Stereo without Photometric Stereo CuesXu Cao, Takafumi TaketomiICCV 2025 · 1 citation
- NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect IlluminationHaoqian Wu, Zhipeng Hu, Lincheng Li, Yongqiang Zhang et al.CVPR 2023
- Neural Microfacet Fields for Inverse RenderingAlexander Mai, Dor Verbin, Falko Kuester, Sara Fridovich-KeilICCV 2023 · 37 citations
