MetaGS: A Meta-Learned Gaussian-Phong Model for Out-of-Distribution 3D Scene Relighting
Yumeng He, Yunbo Wang
Abstract
Out-of-distribution (OOD) 3D relighting requires novel view synthesis under unseen lighting conditions that differ significantly from the observed images. Existing relighting methods, which assume consistent light source distributions between training and testing, often degrade in OOD scenarios. We introduce MetaGS to tackle this challenge from two perspectives. First, we propose a meta-learning approach to train 3D Gaussian splatting, which explicitly promotes learning generalizable Gaussian geometries and appearance attributes across diverse lighting conditions, even with biased training data. Second, we embed fundamental physical priors from the Blinn-Phong reflection model into Gaussian splatting, which enhances the decoupling of shading components and leads to more accurate 3D scene reconstruction. Results on both synthetic and real-world datasets demonstrate the effectiveness of MetaGS in challenging OOD relighting tasks, supporting efficient point-light relighting and generalizing well to unseen environment lighting maps.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on20
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene ReconstructionZiyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao et al.CVPR 2024 · 302 citations
- IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric ImagesKai Zhang, Fujun Luan, Zhengqi Li, Noah SnavelyCVPR 2022 · 85 citations
Related papers
- RelightAnyone: A Generalized Relightable 3D Gaussian Head ModelYingyan Xu, Pramod Rao, Sebastian Weiss, Gaspard Zoss et al.CVPR 2026
- UV-RGS: Relightable 3D Gaussian Splatting from Unposed Views Under Varied IlluminationsWei Feng, Chi Huang, Qi Zhang, Qian Zhang et al.AAAI 2026
- RNG: Relightable Neural GaussiansJiahui Fan, Fujun Luan, Jian Yang, Milos Hasan et al.CVPR 2025
- MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material InferenceWenyuan Zhang, Jimin Tang, Weiqi Zhang, Yi Fang et al.NeurIPS 2025 · 25 citations
- SSD-GS: Scattering and Shadow Decomposition for Relightable 3D Gaussian SplattingIris Zheng, Guojun Tang, Alexander Doronin, Paul D. Teal et al.ICLR 2026 · 2 citations
