ObjectGS: Object-Aware Scene Reconstruction and Scene Understanding via Gaussian Splatting
Ruijie Zhu, Mulin Yu, Linning Xu, Lihan Jiang, Yixuan Li, Tianzhu Zhang, Jiangmiao Pang, Bo Dai
Abstract
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and real-time novel view synthesis, yet its lack of semantic understanding limits object-level perception. In this work, we propose ObjectGS, an object-aware framework that unifies 3D scene reconstruction with semantic understanding. Instead of treating the scene as a unified whole, ObjectGS models individual objects as local anchors that generate neural Gaussians and share object IDs, enabling precise object-level reconstruction. During training, we dynamically grow or prune these anchors and optimize their features, while a one-hot ID encoding with a classification loss enforces clear semantic constraints. We show through extensive experiments that ObjectGS not only outperforms state-of-the-art methods on open-vocabulary and panoptic segmentation tasks, but also integrates seamlessly with applications like mesh extraction and scene editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cbdc85ff-73a5-4855-9ec1-8f4cc58e2b27Cited by top-tier papers8
- OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene UnderstandingSheng-Yu Huang, Jaesung Choe, Yu-Chiang Frank Wang, Cheng SunCVPR 2026 · 5 citations
- Consistent Instance Field for Dynamic Scene UnderstandingJunyi Wu, Van Nguyen Nguyen, Benjamin Planche, Jiachen Tao et al.CVPR 2026 · 3 citations
- MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian SplattingHanzhi Chang, Ruijie Zhu, Wenjie Chang, Mulin Yu et al.AAAI 2026 · 2 citations
- LangField4D: Learning Identity-Adaptive and Spatio-Temporal Continuous 4D Language Fields for Dynamic ScenesYichao Xu, Qiaowei Miao, Jinsheng Quan, Wei Yang et al.CVPR 2026
- BEA-GS: BEyond RAdiance Supervision in 3DGS for Precise Object ExtractionAlessio Mazzucchelli, Maria Naranjo-Almeida, Jorge Bustos-Sanchez, Mariella Dimiccoli et al.CVPR 2026
Builds on31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
Related papers
- Bootstraping Clustering of Gaussians for View-consistent 3D Scene UnderstandingWenbo Zhang, Lu Zhang, Ping Hu, Liqian Ma et al.AAAI 2025 · 4 citations
- Holistic Large-Scale Scene Reconstruction via Mixed Gaussian SplattingChuandong Liu, Huijiao Wang, Lei Yu, Gui-Song XiaNeurIPS 2025 · 4 citations
- Open-Set Semantic Gaussian Splatting SLAM with Expandable RepresentationYucheng Yan, Chen Liang, Wenguan Wang, Yi YangICLR 2026
- NG-GS: NeRF-guided 3D Gaussian Splatting SegmentationYi He, Tao Wang, Yi Jin, Congyan Lang et al.CVPR 2026
- MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian SplattingRuijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng et al.NeurIPS 2024 · 87 citations
