Benchmarking and Analyzing Point Cloud Classification under Corruptions
Jiawei Ren, Liang Pan, Ziwei Liu
Abstract
3D perception, especially point cloud classification, has achieved substantial progress. However, in real-world deployment, point cloud corruptions are inevitable due to the scene complexity, sensor inaccuracy, and processing imprecision. In this work, we aim to rigorously benchmark and analyze point cloud classification under corruptions. To conduct a systematic investigation, we first provide a taxonomy of common 3D corruptions and identify the atomic corruptions. Then, we perform a comprehensive evaluation on a wide range of representative point cloud models to understand their robustness and generalizability. Our benchmark results show that although point cloud classification performance improves over time, the state-of-the-art methods are on the verge of being less robust. Based on the obtained observations, we propose several effective techniques to enhance point cloud classifier robustness. We hope our comprehensive benchmark, in-depth analysis, and proposed techniques could spark future research in robust 3D perception. Code is available at https://github. com/jiawei-ren/modelnetc .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d24cd721-265f-472a-b523-6f9b7a4edc57Cited by top-tier papers30
- Rethinking Range View Representation for LiDAR SegmentationLingdong Kong, Youquan Liu, Runnan Chen, Yuexin Ma et al.ICCV 2023 · 193 citations
- Robo3D: Towards Robust and Reliable 3D Perception against CorruptionsLingdong Kong, Youquan Liu, Xin Li, Runnan Chen et al.ICCV 2023 · 151 citations
- PTTR: Relational 3D Point Cloud Object Tracking with TransformerChangqing Zhou, Zhipeng Luo, Yueru Luo, Tianrui Liu et al.CVPR 2022 · 117 citations
- BiBench: Benchmarking and Analyzing Network BinarizationHaotong Qin, Mingyuan Zhang, Yifu Ding, Aoyu Li et al.ICML 2023 · 53 citations
- MATE: Masked Autoencoders are Online 3D Test-Time LearnersMuhammad Jehanzeb Mirza, Inkyu Shin, Wei Lin, Andreas Schriebl et al.ICCV 2023 · 24 citations
Builds on19
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World DataMikaela Angelina Uy, Quang-Hieu Pham, Binh-Son Hua, Duc Thanh Nguyen et al.ICCV 2019 · 1,003 citations
- Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category ReconstructionJeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone et al.ICCV 2021 · 686 citations
- Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point ModelingXumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang et al.CVPR 2022 · 684 citations
Related papers
- Sample-adaptive Augmentation for Point Cloud Recognition Against Real-world CorruptionsJie Wang, Lihe Ding, Tingfa Xu, Shaocong Dong et al.ICCV 2023 · 13 citations
- EPiC: Ensemble of Partial Point Clouds for Robust ClassificationMeir Yossef Levi, Guy GilboaICCV 2023 · 13 citations
- Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous DrivingYinpeng Dong, Caixin Kang, Jinlai Zhang, Zijian Zhu et al.CVPR 2023
- PointCert: Point Cloud Classification with Deterministic Certified Robustness GuaranteesJinghuai Zhang, Jinyuan Jia, Hongbin Liu, Neil Zhenqiang GongCVPR 2023
- Benchmarking and Analyzing Robust Point Cloud Recognition: Bag of Tricks for Defending Adversarial ExamplesQiufan Ji, Lin Wang, Cong Shi, Shengshan Hu et al.ICCV 2023 · 9 citations
