Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis
Yipengjing Sun, Shengping Zhang, Chenyang Wang, Shunyuan Zheng, Zonglin Li, Xiangyang Ji
摘要
We propose GRGS, a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions. Unlike existing methods that rely on per-character optimization or ignore physical constraints, GRGS adopts a feed-forward, fully supervised strategy projecting geometry, material, and illumination cues from multi-view 2D observations into 3D Gaussian representations. To recover accurate geometry under diverse lighting conditions that supports the relighting process, we introduce a Lighting-robust Geometry Recovery (LGR) module trained on synthetically relit data to predict precise depth and surface normals. Based on these geometry estimates, a Physically Grounded Neural Rendering (PGNR) module is further proposed to integrate neural prediction with physics-based shading, supporting editable relighting with shadows and indirect illumination. Moreover, we design a 2D-to-3D projection training scheme leveraging differentiable supervision from ambient occlusion, direct, and indirect lighting maps, alleviating the computational cost of explicit ray tracing. Extensive experiments demonstrate that GRGS achieves superior visual quality, geometric consistency, and generalization across characters and lighting conditions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper28
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron 等ICCV 2021 · 被引用 608 次
- Neural-PIL: Neural Pre-Integrated Lighting for Reflectance DecompositionMark Boss, Varun Jampani, Raphael Braun, Ce Liu 等NeurIPS 2021 · 被引用 270 次
- Deep Single-Image Portrait RelightingHao Zhou, Sunil Hadap, Kalyan Sunkavalli, David JacobsICCV 2019 · 被引用 247 次
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne 等SIGGRAPH 2021 · 被引用 138 次
相关 Paper
- RNG: Relightable Neural GaussiansJiahui Fan, Fujun Luan, Jian Yang, Milos Hasan 等CVPR 2025
- GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse RenderingHongze Chen, Zehong Lin, Jun ZhangICLR 2025
- GS-IR: 3D Gaussian Splatting for Inverse RenderingZhihao Liang, Qi Zhang, Ying Feng, Ying Shan 等CVPR 2024
- GSHeadRelight: Fast Relightability for 3D Gaussian Head SynthesisHenglei Lv, Bailin Deng, Jianzhu Guo, Xiaoqiang Liu 等SIGGRAPH 2025
- RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and ReflectionYongyang Zhou, Fanglue Zhang, Zichen Wang, Lei ZhangACM MM 2025 · 被引用 4 次
