RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection
Yongyang Zhou, Fanglue Zhang, Zichen Wang, Lei Zhang
Abstract
3D Gaussian Splatting (3DGS) has demonstrated impressive capabilities in novel view synthesis. However, rendering reflective objects remains a significant challenge, particularly in inverse rendering and relighting. We introduce RTR-GS, a novel inverse rendering framework capable of robustly rendering objects with arbitrary reflectance properties, decomposing BRDF and lighting, and delivering credible relighting results. Given a collection of multi-view images, our method effectively recovers geometric structure through a hybrid rendering model that combines forward rendering for radiance transfer with deferred rendering for reflections. This approach successfully separates high-frequency and low-frequency appearances, mitigating floating artifacts caused by spherical harmonic overfitting when handling high-frequency details. We further refine BRDF and lighting decomposition using an additional physically-based deferred rendering branch. Experimental results show that our method enhances novel view synthesis, normal estimation, decomposition, and relighting while maintaining efficient training inference process.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9fa3d9c8-bfd9-4230-84e9-daae9829de5dCited by top-tier papers1
Ask how each one uses itBuilds on35
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
Related papers
- GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse RenderingHongze Chen, Zehong Lin, Jun ZhangICLR 2025
- Reflective Gaussian SplattingYuxuan Yao, Zixuan Zeng, Chun Gu, Xiatian Zhu et al.ICLR 2025
- GS-IR: 3D Gaussian Splatting for Inverse RenderingZhihao Liang, Qi Zhang, Ying Feng, Ying Shan et al.CVPR 2024
- Ref-DGS: Reflective Dual Gaussian SplattingNingjing Fan, Yiqun Wang, Dong-Ming Yan, Peter WonkaSIGGRAPH 2026
- MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material InferenceWenyuan Zhang, Jimin Tang, Weiqi Zhang, Yi Fang et al.NeurIPS 2025 · 25 citations
