GaRe: Relightable 3D Gaussian Splatting for Outdoor Scenes from Unconstrained Photo Collections
Haiyang Bai, Jiaqi Zhu, Songru Jiang, Wei Huang, Tao Lu, Yuanqi Li, Jie Guo, Runze Fu, Yanwen Guo, Lijun Chen
摘要
We propose a 3D Gaussian splatting-based framework for outdoor relighting that leverages intrinsic image decomposition to precisely integrate sunlight, sky radiance, and indirect lighting from unconstrained photo collections. Unlike prior methods that compress the per-image global illumination into a single latent vector, our approach enables simultaneously diverse shading manipulation and the generation of dynamic shadow effects. This is achieved through three key innovations: (1) a residual-based sun visibility extraction method to accurately separate direct sunlight effects, (2) a region-based supervision framework with a structural consistency loss for physically interpretable and coherent illumination decomposition, and (3) a ray-tracing-based technique for realistic shadow simulation. Extensive experiments demonstrate that our framework synthesizes novel views with competitive fidelity against state-of-the-art relighting solutions and produces more natural and multifaceted illumination and shadow effects.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- LuxRemix: Lighting Decomposition and Remixing for Indoor ScenesRuofan Liang, Norman Müller, Ethan Weber, Duncan Zauss 等CVPR 2026 · 被引用 7 次
- IR-HGP: Physically-Aware Gaussian Inverse Rendering for High-Illumination Scenes via Generative PriorsQingan Zhang, Wensheng Li, Chengying GaoCVPR 2026
- Disco-GS: Gaussian Splatting in Dynamic Color LightingAshish Kumar, A. N. RajagopalanCVPR 2026
- EAG-PT: Emission-Aware Gaussians and Path Tracing for Diffuse Indoor Scene Reconstruction and EditingXijie Yang, Mulin Yu, Changjian Jiang, Kerui Ren 等SIGGRAPH 2026
它引用的顶会 Paper20
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao 等NeurIPS 2024 · 被引用 2,305 次
- NeRD: Neural Reflectance Decomposition from Image CollectionsMark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron 等ICCV 2021 · 被引用 608 次
- WildGaussians: 3D Gaussian Splatting In the WildJonas Kulhanek, Songyou Peng, Zuzana Kukelova, Marc Pollefeys 等NeurIPS 2024 · 被引用 202 次
相关 Paper
- GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse RenderingHongze Chen, Zehong Lin, Jun ZhangICLR 2025
- SGS-Intrinsic: Semantic-Invariant Gaussian Splatting for Sparse-View Indoor Inverse RenderingJiahao Niu, Rongjia Zheng, Wenju Xu, Wei-Shi Zheng 等CVPR 2026 · 被引用 1 次
- Illumination-Consistent Human-Scene Reconstruction from Monocular VideoRongbin Zheng, Wensheng Li, Lingzhe Zeng, Dong Wang 等CVPR 2026
- GS-ID: Illumination Decomposition on Gaussian Splatting via Adaptive Light Aggregation and Diffusion-Guided Material PriorsKang Du, Zhihao Liang, Yulin Shen, Zeyu WangICCV 2025 · 被引用 3 次
- Complementary Intrinsics from Neural Radiance Fields and CNNs for Outdoor Scene RelightingSiqi Yang, Xuanning Cui, Yongjie Zhu, Jiajun Tang 等CVPR 2023
