ObjectGS: Object-Aware Scene Reconstruction and Scene Understanding via Gaussian Splatting
Ruijie Zhu, Mulin Yu, Linning Xu, Lihan Jiang, Yixuan Li, Tianzhu Zhang, Jiangmiao Pang, Bo Dai
摘要
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and real-time novel view synthesis, yet its lack of semantic understanding limits object-level perception. In this work, we propose ObjectGS, an object-aware framework that unifies 3D scene reconstruction with semantic understanding. Instead of treating the scene as a unified whole, ObjectGS models individual objects as local anchors that generate neural Gaussians and share object IDs, enabling precise object-level reconstruction. During training, we dynamically grow or prune these anchors and optimize their features, while a one-hot ID encoding with a classification loss enforces clear semantic constraints. We show through extensive experiments that ObjectGS not only outperforms state-of-the-art methods on open-vocabulary and panoptic segmentation tasks, but also integrates seamlessly with applications like mesh extraction and scene editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene UnderstandingSheng-Yu Huang, Jaesung Choe, Yu-Chiang Frank Wang, Cheng SunCVPR 2026 · 被引用 5 次
- Consistent Instance Field for Dynamic Scene UnderstandingJunyi Wu, Van Nguyen Nguyen, Benjamin Planche, Jiachen Tao 等CVPR 2026 · 被引用 3 次
- MeshSplat: Generalizable Sparse-View Surface Reconstruction via Gaussian SplattingHanzhi Chang, Ruijie Zhu, Wenjie Chang, Mulin Yu 等AAAI 2026 · 被引用 2 次
- LangField4D: Learning Identity-Adaptive and Spatio-Temporal Continuous 4D Language Fields for Dynamic ScenesYichao Xu, Qiaowei Miao, Jinsheng Quan, Wei Yang 等CVPR 2026
- BEA-GS: BEyond RAdiance Supervision in 3DGS for Precise Object ExtractionAlessio Mazzucchelli, Maria Naranjo-Almeida, Jorge Bustos-Sanchez, Mariella Dimiccoli 等CVPR 2026
它引用的顶会 Paper31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
相关 Paper
- Bootstraping Clustering of Gaussians for View-consistent 3D Scene UnderstandingWenbo Zhang, Lu Zhang, Ping Hu, Liqian Ma 等AAAI 2025 · 被引用 4 次
- Holistic Large-Scale Scene Reconstruction via Mixed Gaussian SplattingChuandong Liu, Huijiao Wang, Lei Yu, Gui-Song XiaNeurIPS 2025 · 被引用 4 次
- Open-Set Semantic Gaussian Splatting SLAM with Expandable RepresentationYucheng Yan, Chen Liang, Wenguan Wang, Yi YangICLR 2026
- NG-GS: NeRF-guided 3D Gaussian Splatting SegmentationYi He, Tao Wang, Yi Jin, Congyan Lang 等CVPR 2026
- MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian SplattingRuijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng 等NeurIPS 2024 · 被引用 87 次
