Contrastive Boundary Learning for Point Cloud Segmentation
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao
Abstract
Point cloud segmentation is fundamental in understanding 3D environments. However, current 3D point cloud segmentation methods usually perform poorly on scene boundaries, which degenerates the overall segmentation performance. In this paper, we focus on the segmentation of scene boundaries. Accordingly, we first explore metrics to evaluate the segmentation performance on scene boundaries. To address the unsatisfactory performance on boundaries, we then propose a novel contrastive boundary learning (CBL) framework for point cloud segmentation. Specifically, the proposed CBL enhances feature discrimination between points across boundaries by contrasting their representations with the assistance of scene contexts at multiple scales. By applying CBL on three different baseline methods, we experimentally show that CBL consistently improves different baselines and assists them to achieve compelling performance on boundaries, as well as the overall performance, e.g. in mIoU. The experimental results demonstrate the effectiveness of our method and the importance of boundaries for 3D point cloud segmentation. Code and model will be made publicly available at https://github.com/LiyaoTang/contrastBoundary .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b674bc30-ae76-4e06-bbd8-eeb01ced0dbfCited by top-tier papers29
- PointNeXt: Revisiting PointNet++ with Improved Training and Scaling StrategiesGuocheng Qian, Yuchen Li, Houwen Peng, Jinjie Mai et al.NeurIPS 2022 · 1,270 citations
- Implicit Autoencoder for Point-Cloud Self-Supervised Representation LearningSiming Yan, Zhenpei Yang, Haoxiang Li, Chen Song et al.ICCV 2023 · 82 citations
- Clustering based Point Cloud Representation Learning for 3D AnalysisTuo Feng, Wenguan Wang, Xiaohan Wang, Yi Yang et al.ICCV 2023 · 53 citations
- InfoCD: A Contrastive Chamfer Distance Loss for Point Cloud CompletionFangzhou Lin, Yun Yue, Ziming Zhang, Songlin Hou et al.NeurIPS 2023 · 49 citations
- OmniVec2 - A Novel Transformer Based Network for Large Scale Multimodal and Multitask LearningSiddharth Srivastava, Gaurav SharmaCVPR 2024 · 32 citations
Builds on22
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Exploring Cross-Image Pixel Contrast for Semantic SegmentationWenguan Wang, Tianfei Zhou, Fisher Yu, Jifeng Dai et al.ICCV 2021 · 568 citations
- ShellNet: Efficient Point Cloud Convolutional Neural Networks Using Concentric Shells StatisticsZhiyuan Zhang, Binh-Son Hua, Sai-Kit YeungICCV 2019 · 400 citations
- Hierarchical Point-Edge Interaction Network for Point Cloud Semantic SegmentationLi Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen et al.ICCV 2019 · 213 citations
Related papers
- Multi-fineness Boundaries and the Shifted Ensemble-aware Encoding for Point Cloud Semantic SegmentationZiming Wang, Boxiang Zhang, Ming Ma, Yue Wang et al.ACM MM 2024 · 2 citations
- FAC: 3D Representation Learning via Foreground Aware Feature ContrastKangcheng Liu, Aoran Xiao, Xiaoqin Zhang, Shijian Lu et al.CVPR 2023
- Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation LearningXiaoyang Wu, Xin Wen, Xihui Liu, Hengshuang ZhaoCVPR 2023
- GroupContrast: Semantic-Aware Self-Supervised Representation Learning for 3D UnderstandingChengyao Wang, Li Jiang, Xiaoyang Wu, Zhuotao Tian et al.CVPR 2024 · 18 citations
- Vision-Language Pre-training with Object Contrastive Learning for 3D Scene UnderstandingTaolin Zhang, Sunan He, Tao Dai, Zhi Wang et al.AAAI 2024 · 42 citations
