RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting
Ji Shi, Xianghua Ying, Bowei Xing, Ruohao Guo, Wenzhen Yue
Abstract
3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting , a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6bb12c17-b6d9-4c28-a7d4-17fcb6b1effcBuilds on29
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
- Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance FieldsDor Verbin, Peter Hedman, Ben Mildenhall, Todd E. Zickler et al.CVPR 2022 · 477 citations
- NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview ImagesYuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long et al.SIGGRAPH 2023 · 128 citations
Related papers
- Ref-DGS: Reflective Dual Gaussian SplattingNingjing Fan, Yiqun Wang, Dong-Ming Yan, Peter WonkaSIGGRAPH 2026
- RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and ReflectionYongyang Zhou, Fanglue Zhang, Zichen Wang, Lei ZhangACM MM 2025 · 4 citations
- ReflFlow: Learning Geometry-Guided Ray Tracing for Dynamic Specular ReconstructionJiachen Tao, Junyi Wu, Haoxuan Wang, Zongxin Yang et al.ICML 2026
- Reflective Gaussian SplattingYuxuan Yao, Zixuan Zeng, Chun Gu, Xiatian Zhu et al.ICLR 2025
- TransparentGS: Fast Inverse Rendering of Transparent Objects with GaussiansLetian Huang, Dongwei Ye, Jialin Dan, Chengzhi Tao et al.SIGGRAPH 2025 · 5 citations
