Fix False Transparency by Noise Guided Splatting
Aly El Hakie, Yiren Lu, Yu Yin, Michael Jenkins, Yehe Liu
摘要
Opaque objects reconstructed by 3D Gaussian Splatting (3DGS) often exhibit a falsely transparent surface, leading to inconsistent background and internal patterns under camera motion in interactive viewing. This issue stems from the ill-posed optimization in 3DGS. During training, background and foreground Gaussians are blended via α-compositing and optimized solely against the input RGB images using a photometric loss. As this process lacks an explicit constraint on surface opacity, the optimization may incorrectly assign transparency to opaque regions, resulting in view-inconsistent and falsely transparent. This issue is difficult to detect in standard evaluation settings (i.e., rendering static images) but becomes particularly evident in object-centric reconstructions under interactive viewing. Although other causes of view-inconsistency (e.g., popping artifacts) have been explored recently, false transparency has not been explicitly identified. To the best of our knowledge, we are the first to identify, characterize, and develop solutions for this "false transparency" artifact, an underreported artifact in 3DGS. Our strategy, Noise Guided Splatting (NGS), encourages surface Gaussians to adopt higher opacity by injecting opaque noise Gaussians in the object volume during training, requiring only minimal modifications to the existing splatting process. To quantitatively evaluate false transparency in static renderings, we propose a transmittance-based metric that measures the severity of this artifact. In addition, we introduce a customized, high-quality object-centric scan dataset exhibiting pronounced transparency issues, and we augment popular existing datasets (e.g., DTU) with complementary infill noise specifically designed to assess the robustness of 3D reconstruction methods to false transparency. Experiments across multiple datasets show that NGS substantially reduces false transparency while maintaining competitive performance on standard rendering metrics (e.g., PSNR), demonstrating its overall effectiveness.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Segment Any 3D GaussiansJiazhong Cen, Jiemin Fang, Chen Yang, Lingxi Xie 等AAAI 2025 · 被引用 175 次
- LangSplat: 3D Language Gaussian SplattingMinghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang 等CVPR 2024 · 被引用 164 次
- StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time RenderingLukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch 等SIGGRAPH 2024 · 被引用 93 次
相关 Paper
- TSPE-GS: Probabilistic Depth Extraction for Semi-Transparent Surface Reconstruction via 3D Gaussian SplattingZhiyuan Xu, Nan Min, Yuhang Guo, Tong WeiAAAI 2026
- Perceptual Quality Assessment of 3D Gaussian Splatting: A Subjective Dataset and Prediction MetricZhaolin Wan, Yining Diao, Jingqi Xu, Hao Wang 等AAAI 2026 · 被引用 1 次
- RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian SplattingJi Shi, Xianghua Ying, Bowei Xing, Ruohao Guo 等CVPR 2026 · 被引用 2 次
- Gaussian Blending: Rethinking Alpha Blending in 3D Gaussian SplattingJunseo Koo, Jinseo Jeong, Gunhee KimAAAI 2026
- Textured Gaussians for Enhanced 3D Scene Appearance ModelingBrian Chao, Hung-Yu Tseng, Lorenzo Porzi, Chen Gao 等CVPR 2025
