Geometric-Aware Hypergraph Reasoning for Novel Class Discovery in Point Cloud Segmentation
Zihao Zhang, Aming Wu, Li Yang, Yahong Han, Jialie Shen
Abstract
Novel Class Discovery in Point Cloud Segmentation is recently proposed, aiming to leverage knowledge from known classes to automatically segment unlabeled classes within point clouds. The core of this task lies in leveraging the geometric and semantic knowledge of multiple known classes to achieve semantic understanding and segmentation of novel classes. However, existing methods overlook the high-order associations between known and novel classes, relying solely on binary associations for class assignment and novel class reasoning, which leads to less precise semantic segmentation. To address these issues, we introduce a hypergraph structure to model high-order associations among classes, enabling collaborative reasoning from known classes to novel classes, extending beyond traditional binary relations. Additionally, existing methods focus excessively on extracting semantic information when processing point cloud data, neglecting the importance of geometric features. To address this, we introduce a novel prototype, Geometric-Aware Prototypes, enhancing the model's ability to capture geometric spatial information. By propagating geometric information through hyperedges, our method enhances the understanding of spatial distributions across classes, improving segmentation accuracy. Significant performance improvements achieved on the SemanticKITTI and SemanticPOSS datasets demonstrate the superiority of our method. Our code is available at https://github.com/2490o/HyperNCD.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2c55aab3-e49d-41e1-bf92-5502e0f9a8b9Builds on19
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- OpenMask3D: Open-Vocabulary 3D Instance SegmentationAyça Takmaz, Elisabetta Fedele, Robert W. Sumner, Marc Pollefeys et al.NeurIPS 2023 · 389 citations
- Learning to Discover Novel Visual Categories via Deep Transfer ClusteringKai Han, Andrea Vedaldi, Andrew ZissermanICCV 2019 · 378 citations
- A Unified Objective for Novel Class DiscoveryEnrico Fini, Enver Sangineto, Stéphane Lathuilière, Zhun Zhong et al.ICCV 2021 · 248 citations
Related papers
- Novel Class Discovery for Point Cloud Segmentation via Joint Learning of Causal Representation and ReasoningYang Li, Aming Wu, Zihao Zhang, Yahong HanNeurIPS 2025 · 2 citations
- Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic SegmentationYuwei Yang, Munawar Hayat, Zhao Jin, Chao Ren et al.CVPR 2023
- Generalized Few-Shot Point Cloud Segmentation Via Geometric WordsYating Xu, Conghui Hu, Na Zhao, Gim Hee LeeICCV 2023 · 18 citations
- Few-Shot 3D Point Cloud Semantic SegmentationNa Zhao, Tat-Seng Chua, Gim Hee LeeCVPR 2021
- Unified 3D Segmenter As Prototypical ClassifiersZheyun Qin, Cheng Han, Qifan Wang, Xiushan Nie et al.NeurIPS 2023 · 27 citations
