Superpoint Network for Point Cloud Oversegmentation
Le Hui, Jia Yuan, Mingmei Cheng, Jin Xie, Xiaoya Zhang, Jian Yang
Abstract
Superpoints are formed by grouping similar points with local geometric structures, which can effectively reduce the number of primitives of point clouds for subsequent point cloud processing. Existing superpoint methods mainly focus on employing clustering or graph partition to generate superpoints with handcrafted or learned features. Nonetheless, these methods cannot learn superpoints of point clouds with an end-to-end network. In this paper, we develop a new deep iterative clustering network to directly generate superpoints from irregular 3D point clouds in an end-to-end manner. Specifically, in our clustering network, we first jointly learn a soft point-superpoint association map from the coordinate and feature spaces of point clouds, where each point is assigned to the superpoint with a learned weight. Furthermore, we then iteratively update the association map and superpoint centers so that we can more accurately group the points into the corresponding superpoints with locally similar geometric structures. Finally, by predicting the pseudo labels of the superpoint centers, we formulate a label consistency loss on the points and superpoint centers to train the network. Extensive experiments on various datasets indicate that our method not only achieves the state-of-the-art on superpoint generation but also improves the performance of point cloud semantic segmentation. Code is available at https: //github.com/fpthink/SPNet .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bfe1e6bd-2a86-4b65-a2f1-b886a1fe308fCited by top-tier papers14
- Efficient 3D Semantic Segmentation with Superpoint TransformerDamien Robert, Hugo Raguet, Loïc LandrieuICCV 2023 · 131 citations
- 3D Siamese Voxel-to-BEV Tracker for Sparse Point CloudsLe Hui, Lingpeng Wang, Mingmei Cheng, Jin Xie et al.NeurIPS 2021 · 105 citations
- Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene ReconstructionDiwen Wan, Ruijie Lu, Gang ZengICML 2024 · 43 citations
- SPGroup3D: Superpoint Grouping Network for Indoor 3D Object DetectionYun Zhu, Le Hui, Yaqi Shen, Jin XieAAAI 2024 · 24 citations
- Learning Superpoint Graph Cut for 3D Instance SegmentationLe Hui, Linghua Tang, Yaqi Shen, Jin Xie et al.NeurIPS 2022 · 7 citations
Builds on5
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- ShellNet: Efficient Point Cloud Convolutional Neural Networks Using Concentric Shells StatisticsZhiyuan Zhang, Binh-Son Hua, Sai-Kit YeungICCV 2019 · 400 citations
- Morphing and Sampling Network for Dense Point Cloud CompletionMinghua Liu, Lu Sheng, Sheng Yang, Jing Shao et al.AAAI 2020 · 363 citations
- SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation NetworkMingmei Cheng, Le Hui, Jin Xie, Jian YangAAAI 2021 · 124 citations
- RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point CloudsQingyong Hu, Bo Yang, Linhai Xie, Stefano Rosa et al.CVPR 2020
Related papers
- Self-Supervised 3D Scene Flow Estimation Guided by SuperpointsYaqi Shen, Le Hui, Jin Xie, Jian YangCVPR 2023
- Efficient LiDAR Point Cloud Oversegmentation NetworkLe Hui, Linghua Tang, Yuchao Dai, Jin Xie et al.ICCV 2023 · 7 citations
- SK-Net: Deep Learning on Point Cloud via End-to-End Discovery of Spatial KeypointsWeikun Wu, Yan Zhang, David Wang, Yunqi LeiAAAI 2020 · 56 citations
- Instance Segmentation in 3D Scenes using Semantic Superpoint Tree NetworksZhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan et al.ICCV 2021 · 170 citations
- Superpoint Transformer for 3D Scene Instance SegmentationJiahao Sun, Chunmei Qing, Junpeng Tan, Xiangmin XuAAAI 2023 · 181 citations
