NG-GS: NeRF-guided 3D Gaussian Splatting Segmentation
Yi He, Tao Wang, Yi Jin, Congyan Lang, Yidong Li, Haibin Ling
Abstract
Recent advances in 3D Gaussian Splatting (3DGS) have enabled highly efficient and photorealistic novel view synthesis. However, segmenting objects accurately in 3DGS remains challenging due to the discrete nature of Gaussian representations, which often leads to aliasing and artifacts at object boundaries. In this paper, we introduce NG-GS, a novel framework for high-quality object segmentation in 3DGS that explicitly addresses boundary discretization. Our approach begins by automatically identifying ambiguous Gaussians at object boundaries using mask variance analysis. We then apply radial basis function (RBF) interpolation to construct a spatially continuous feature field, enhanced by multi-resolution hash encoding for efficient multi-scale representation. A joint optimization strategy aligns 3DGS with a lightweight NeRF module through alignment and spatial continuity losses, ensuring smooth and consistent segmentation boundaries. Extensive experiments on NVOS, LERF-OVS, and ScanNet benchmarks demonstrate that our method achieves state-of-the-art performance, with significant gains in boundary mIoU. Code is available at https://github.com/BJTU-KD3D/NG-GS.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fe46e046-409e-40a0-bf65-9078e7f5b5acBuilds on24
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Language-driven Semantic SegmentationBoyi Li, Kilian Q. Weinberger, Serge J. Belongie, Vladlen Koltun et al.ICLR 2022 · 885 citations
Related papers
- NeRF is a Valuable Assistant for 3D Gaussian SplattingShuangkang Fang, I-Chao Shen, Takeo Igarashi, Yufeng Wang et al.ICCV 2025 · 6 citations
- UniC-Lift: Unified 3D Instance Segmentation via Contrastive LearningAnkit Dhiman, R. Srinath, Jaswanth Reddy, Lokesh R. Boregowda et al.AAAI 2026
- Splat and Replace: 3D Reconstruction with Repetitive ElementsNicolás Violante, Andreas Meuleman, Alban Gauthier, Frédo Durand et al.SIGGRAPH 2025 · 4 citations
- Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View SynthesisRui Peng, Wangze Xu, Luyang Tang, Levio Leo et al.NeurIPS 2024 · 32 citations
- Mani-GS: Gaussian Splatting Manipulation with Triangular MeshXiangjun Gao, Xiaoyu Li, Yiyu Zhuang, Qi Zhang et al.CVPR 2025
