Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis
Yipengjing Sun, Shengping Zhang, Chenyang Wang, Shunyuan Zheng, Zonglin Li, Xiangyang Ji
Abstract
We propose GRGS, a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions. Unlike existing methods that rely on per-character optimization or ignore physical constraints, GRGS adopts a feed-forward, fully supervised strategy projecting geometry, material, and illumination cues from multi-view 2D observations into 3D Gaussian representations. To recover accurate geometry under diverse lighting conditions that supports the relighting process, we introduce a Lighting-robust Geometry Recovery (LGR) module trained on synthetically relit data to predict precise depth and surface normals. Based on these geometry estimates, a Physically Grounded Neural Rendering (PGNR) module is further proposed to integrate neural prediction with physics-based shading, supporting editable relighting with shadows and indirect illumination. Moreover, we design a 2D-to-3D projection training scheme leveraging differentiable supervision from ambient occlusion, direct, and indirect lighting maps, alleviating the computational cost of explicit ray tracing. Extensive experiments demonstrate that GRGS achieves superior visual quality, geometric consistency, and generalization across characters and lighting conditions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d94e11cb-182f-4128-b951-03ed84367cb0Cited by top-tier papers1
Ask how each one uses itBuilds on28
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron et al.ICCV 2021 · 608 citations
- Neural-PIL: Neural Pre-Integrated Lighting for Reflectance DecompositionMark Boss, Varun Jampani, Raphael Braun, Ce Liu et al.NeurIPS 2021 · 270 citations
- Deep Single-Image Portrait RelightingHao Zhou, Sunil Hadap, Kalyan Sunkavalli, David JacobsICCV 2019 · 247 citations
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne et al.SIGGRAPH 2021 · 138 citations
Related papers
- RNG: Relightable Neural GaussiansJiahui Fan, Fujun Luan, Jian Yang, Milos Hasan et al.CVPR 2025
- GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse RenderingHongze Chen, Zehong Lin, Jun ZhangICLR 2025
- GS-IR: 3D Gaussian Splatting for Inverse RenderingZhihao Liang, Qi Zhang, Ying Feng, Ying Shan et al.CVPR 2024
- GSHeadRelight: Fast Relightability for 3D Gaussian Head SynthesisHenglei Lv, Bailin Deng, Jianzhu Guo, Xiaoqiang Liu et al.SIGGRAPH 2025
- RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and ReflectionYongyang Zhou, Fanglue Zhang, Zichen Wang, Lei ZhangACM MM 2025 · 4 citations
