HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
Mengtian Li, Yuan Xie, Yunhang Shen, Bo Ke, Ruizhi Qiao, Bo Ren, Shaohui Lin, Lizhuang Ma
Abstract
To address the huge labeling cost in large-scale point cloud semantic segmentation, we propose a novel hybrid contrastive regularization (HybridCR) framework in weakly-supervised setting, which obtains competitive performance compared to its fully-supervised counterpart. Specifically, HybridCR is the first framework to leverage both point consistency and employ contrastive regularization with pseudo labeling in an end-to-end manner. Fundamentally, HybridCR explicitly and effectively considers the semantic similarity between local neighboring points and global characteristics of 3D classes. We further design a dynamic point cloud augmentor to generate diversity and robust sample views, whose transformation parameter is jointly optimized with model training. Through extensive experiments, HybridCR achieves significant performance improvement against the SOTA methods on both indoor and outdoor datasets, e.g., S3DIS, ScanNet-V2, Se-mantic3D, and SemanticKITTI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f024fbd7-afc4-426a-8a19-a9f9bdbffb89Cited by top-tier papers17
- Hierarchical Point-based Active Learning for Semi-supervised Point Cloud Semantic SegmentationZongyi Xu, Bo Yuan, Shanshan Zhao, Qianni Zhang et al.ICCV 2023 · 31 citations
- CPCM: Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic SegmentationLizhao Liu, Zhuangwei Zhuang, Shangxin Huang, Xunlong Xiao et al.ICCV 2023 · 31 citations
- 2D-3D Interlaced Transformer for Point Cloud Segmentation with Scene-Level SupervisionCheng-Kun Yang, Min-Hung Chen, Yung-Yu Chuang, Yen-Yu LinICCV 2023 · 30 citations
- Unified 3D Segmenter As Prototypical ClassifiersZheyun Qin, Cheng Han, Qifan Wang, Xiushan Nie et al.NeurIPS 2023 · 27 citations
- All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D SegmentationLiyao Tang, Zhe Chen, Shanshan Zhao, Chaoyue Wang et al.NeurIPS 2023 · 26 citations
Builds on19
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised LearningMamshad Nayeem Rizve, Kevin Duarte, Yogesh S. Rawat, Mubarak ShahICLR 2021 · 630 citations
- ShellNet: Efficient Point Cloud Convolutional Neural Networks Using Concentric Shells StatisticsZhiyuan Zhang, Binh-Son Hua, Sai-Kit YeungICCV 2019 · 400 citations
Related papers
- Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic SegmentationLi Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai et al.ICCV 2021 · 137 citations
- Weakly Supervised 3D Segmentation via Receptive-Driven Pseudo Label Consistency and Structural ConsistencyYuxiang Lan, Yachao Zhang, Yanyun Qu, Cong Wang et al.AAAI 2023 · 14 citations
- Weakly Supervised Semantic Segmentation for Large-Scale Point CloudYachao Zhang, Zhonghao Li, Yuan Xie, Yanyun Qu et al.AAAI 2021 · 116 citations
- Multi-Path Region Mining for Weakly Supervised 3D Semantic Segmentation on Point CloudsJiacheng Wei, Guosheng Lin, Kim-Hui Yap, Tzu-Yi Hung et al.CVPR 2020
- Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point SupervisionShichao Dong, Ruibo Li, Jiacheng Wei, Fayao Liu et al.ICCV 2023 · 4 citations
