See Through the Occlusions: Few-Shot Gaussian Splatting with Layered Amodal Supervision
Gwon-Jung Kim, Du Yeol Lee, Jae Hong Yang, Chae-Eun Rhee
摘要
High-quality three-dimensional (3D) reconstruction from sparse views is critical for applications such as virtual and augmented reality, robotics, and digital content creation. While methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have shown strong performance in novel view synthesis, they struggle in few-shot settings, especially when scenes contain large occluded or unseen regions. The lack of explicit supervision for hidden content limits reconstruction completeness and realism. We propose See-Through-the-Occlusion Gaussian Splatting (STO-GS), a novel framework that rethinks occlusion modeling in static scenes. Drawing inspiration from four-dimensional Gaussian Splatting (4DGS), we reinterpret time as a proxy for occlusion depth and apply deformation-based opacity modulation to recover hidden layers. To provide supervision, we generate amodal views via diffusion-based inpainting, exposing occluded structures for training. A two-stage layered training pipeline further refines the reconstruction, with a multi-layer perceptron (MLP) adjusting Gaussian opacity across occlusion layers. STO-GS improves occlusion-aware reconstruction and achieves superior performance over existing few-shot 3DGS baselines, including a 0.51 dB gain on challenging datasets.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage TrainingRuihong Yin, Vladimir Yugay, Yue Li, Sezer Karaoglu 等NeurIPS 2024 · 被引用 29 次
- Splat and Replace: 3D Reconstruction with Repetitive ElementsNicolás Violante, Andreas Meuleman, Alban Gauthier, Frédo Durand 等SIGGRAPH 2025 · 被引用 4 次
- 4D Gaussian Splatting in the Wild with Uncertainty-Aware RegularizationMijeong Kim, Jongwoo Lim, Bohyung HanNeurIPS 2024 · 被引用 33 次
- 4D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular VideosMengqi Guo, Bo Xu, Yanyan Li, Gim Hee LeeNeurIPS 2025 · 被引用 2 次
- 4C4D: 4 Camera 4D Gaussian SplattingJunsheng Zhou, Zhifan Yang, Liang Han, Wenyuan Zhang 等CVPR 2026 · 被引用 4 次
