Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning
Bi'an Du, Xiang Gao, Wei Hu, Xin Li
Abstract
Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel self-contrastive learning for self-supervised point cloud representation learning, aiming to capture both local geometric patterns and nonlocal semantic primitives based on the nonlocal self-similarity of point clouds. The contributions are two-fold: on the one hand, instead of contrasting among different point clouds as commonly employed in contrastive learning, we exploit self-similar point cloud patches within a single point cloud as positive samples and otherwise negative ones to facilitate the task of contrastive learning. On the other hand, we actively learn hard negative samples that are close to positive samples for discriminative feature learning, which are sampled conditional on each anchor patch leveraging on the degree of self-similarity. Experimental results show that the proposed method achieves state-of-the-art performance on widely used benchmark datasets for self-supervised point cloud segmentation and transfer learning for classification.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dbbac795-f9d3-4daf-b7a3-dd9311bc4a78Cited by top-tier papers16
- CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud UnderstandingMohamed Afham, Isuru Dissanayake, Dinithi Dissanayake, Amaya Dharmasiri et al.CVPR 2022 · 286 citations
- Image-to-Lidar Self-Supervised Distillation for Autonomous Driving DataCorentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch et al.CVPR 2022 · 102 citations
- Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation ModelsZhimin Chen, Longlong Jing, Yingwei Li, Bing LiNeurIPS 2023 · 57 citations
- InfoCD: A Contrastive Chamfer Distance Loss for Point Cloud CompletionFangzhou Lin, Yun Yue, Ziming Zhang, Songlin Hou et al.NeurIPS 2023 · 49 citations
- Rethinking the compositionality of point clouds through regularization in the hyperbolic spaceAntonio Montanaro, Diego Valsesia, Enrico MagliNeurIPS 2022 · 46 citations
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- Contrastive Learning with Hard Negative SamplesJoshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie JegelkaICLR 2021 · 999 citations
- Hard Negative Mixing for Contrastive LearningYannis Kalantidis, Mert Bülent Sariyildiz, Noé Pion, Philippe Weinzaepfel et al.NeurIPS 2020 · 805 citations
- Unsupervised Multi-Task Feature Learning on Point CloudsKaveh Hassani, Mike HaleyICCV 2019 · 205 citations
Related papers
- GroupContrast: Semantic-Aware Self-Supervised Representation Learning for 3D UnderstandingChengyao Wang, Li Jiang, Xiaoyang Wu, Zhuotao Tian et al.CVPR 2024 · 18 citations
- Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud VideosXiaoxiao Sheng, Zhiqiang Shen, Gang Xiao, Longguang Wang et al.ICCV 2023 · 20 citations
- PointCMP: Contrastive Mask Prediction for Self-supervised Learning on Point Cloud VideosZhiqiang Shen, Xiaoxiao Sheng, Longguang Wang, Yulan Guo et al.CVPR 2023
- Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised LearningXiaoxiao Sheng, Zhiqiang Shen, Gang XiaoAAAI 2023 · 14 citations
- Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic SegmentationLi Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai et al.ICCV 2021 · 137 citations
