Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination
Peng-Shuai Wang, Yu-Qi Yang, Qian-Fang Zou, Zhirong Wu, Yang Liu, Xin Tong
Abstract
We propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. Our key idea is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HRNet to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, Our network is concatenated with simple task-specific back-ends and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods. For fine-grained shape segmentation on the PartNet dataset, our method even surpasses existing supervised methods by a large margin.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a74b6be5-08bc-42a9-a4b3-6dfa8b83d28bCited by top-tier papers11
- Image-to-Lidar Self-Supervised Distillation for Autonomous Driving DataCorentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch et al.CVPR 2022 · 102 citations
- Implicit Autoencoder for Point-Cloud Self-Supervised Representation LearningSiming Yan, Zhenpei Yang, Haoxiang Li, Chen Song et al.ICCV 2023 · 82 citations
- Shape Self-Correction for Unsupervised Point Cloud UnderstandingYe Chen, Jinxian Liu, Bingbing Ni, Hang Wang et al.ICCV 2021 · 58 citations
- BuildingNet: Learning to Label 3D BuildingsPratheba Selvaraju, Mohamed Nabail, Marios Loizou, Maria Maslioukova et al.ICCV 2021 · 54 citations
- 3D Feature Prediction for Masked-AutoEncoder-Based Point Cloud PretrainingSiming Yan, Yuqi Yang, Yu-Xiao Guo, Hao Pan et al.ICLR 2024 · 21 citations
Builds on4
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Deep Closest Point: Learning Representations for Point Cloud RegistrationYue Wang, Justin SolomonICCV 2019 · 1,026 citations
- Unsupervised Multi-Task Feature Learning on Point CloudsKaveh Hassani, Mike HaleyICCV 2019 · 205 citations
- Momentum Contrast for Unsupervised Visual Representation LearningKaiming He, Haoqi Fan, Yuxin Wu, Saining Xie et al.CVPR 2020
Related papers
- JSNet: Joint Instance and Semantic Segmentation of 3D Point CloudsLin Zhao, Wenbing TaoAAAI 2020 · 127 citations
- Unsupervised Point Cloud Pre-training via Occlusion CompletionHanchen Wang, Qi Liu, Xiangyu Yue, Joan Lasenby et al.ICCV 2021 · 323 citations
- Self-Supervised Learning on 3D Point Clouds by Learning Discrete Generative ModelsBenjamin Eckart, Wentao Yuan, Chao Liu, Jan KautzCVPR 2021
- PointGMM: A Neural GMM Network for Point CloudsAmir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-OrCVPR 2020
- HGNet: Learning Hierarchical Geometry from Points, Edges, and SurfacesTing Yao, Yehao Li, Yingwei Pan, Tao MeiCVPR 2023
