NG-GS: NeRF-guided 3D Gaussian Splatting Segmentation
Yi He, Tao Wang, Yi Jin, Congyan Lang, Yidong Li, Haibin Ling
摘要
Recent advances in 3D Gaussian Splatting (3DGS) have enabled highly efficient and photorealistic novel view synthesis. However, segmenting objects accurately in 3DGS remains challenging due to the discrete nature of Gaussian representations, which often leads to aliasing and artifacts at object boundaries. In this paper, we introduce NG-GS, a novel framework for high-quality object segmentation in 3DGS that explicitly addresses boundary discretization. Our approach begins by automatically identifying ambiguous Gaussians at object boundaries using mask variance analysis. We then apply radial basis function (RBF) interpolation to construct a spatially continuous feature field, enhanced by multi-resolution hash encoding for efficient multi-scale representation. A joint optimization strategy aligns 3DGS with a lightweight NeRF module through alignment and spatial continuity losses, ensuring smooth and consistent segmentation boundaries. Extensive experiments on NVOS, LERF-OVS, and ScanNet benchmarks demonstrate that our method achieves state-of-the-art performance, with significant gains in boundary mIoU. Code is available at https://github.com/BJTU-KD3D/NG-GS.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper24
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Language-driven Semantic SegmentationBoyi Li, Kilian Q. Weinberger, Serge J. Belongie, Vladlen Koltun 等ICLR 2022 · 被引用 885 次
相关 Paper
- NeRF is a Valuable Assistant for 3D Gaussian SplattingShuangkang Fang, I-Chao Shen, Takeo Igarashi, Yufeng Wang 等ICCV 2025 · 被引用 6 次
- UniC-Lift: Unified 3D Instance Segmentation via Contrastive LearningAnkit Dhiman, R. Srinath, Jaswanth Reddy, Lokesh R. Boregowda 等AAAI 2026
- Splat and Replace: 3D Reconstruction with Repetitive ElementsNicolás Violante, Andreas Meuleman, Alban Gauthier, Frédo Durand 等SIGGRAPH 2025 · 被引用 4 次
- Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View SynthesisRui Peng, Wangze Xu, Luyang Tang, Levio Leo 等NeurIPS 2024 · 被引用 32 次
- Mani-GS: Gaussian Splatting Manipulation with Triangular MeshXiangjun Gao, Xiaoyu Li, Yiyu Zhuang, Qi Zhang 等CVPR 2025
