Adversarially Robust 3D Point Cloud Recognition Using Self-Supervisions
Jiachen Sun, Yulong Cao, Christopher B. Choy, Zhiding Yu, Anima Anandkumar, Zhuoqing Morley Mao, Chaowei Xiao
Abstract
3D point cloud data is increasingly used in safety-critical applications such as autonomous driving. Thus, the robustness of 3D deep learning models against adversarial attacks becomes a major consideration. In this paper, we systematically study the impact of various self-supervised learning proxy tasks on different architectures and threat models for 3D point clouds with adversarial training. Specifically, we study MLP-based (PointNet), convolution-based (DGCNN), and transformer-based (PCT) 3D architectures. Through extensive experimentation, we demonstrate that appropriate applications of self-supervision can significantly enhance the robustness in 3D point cloud recognition, achieving considerable improvements compared to the standard adversarial training baseline. Our analysis reveals that local feature learning is desirable for adversarial robustness in point clouds since it limits the adversarial propagation between the point-level input perturbations and the model's final output. This insight also explains the success of DGCNN and the jigsaw proxy task in achieving stronger 3D adversarial robustness.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 494f6074-ff46-4572-b3e4-3f874588d743Cited by top-tier papers20
- On Adversarial Robustness of Trajectory Prediction for Autonomous VehiclesQingzhao Zhang, Shengtuo Hu, Jiachen Sun, Qi Alfred Chen et al.CVPR 2022 · 132 citations
- Benchmarking and Analyzing Point Cloud Classification under CorruptionsJiawei Ren, Liang Pan, Ziwei LiuICML 2022 · 114 citations
- Shape-invariant 3D Adversarial Point CloudsQidong Huang, Xiaoyi Dong, Dongdong Chen, Hang Zhou et al.CVPR 2022 · 88 citations
- Isometric 3D Adversarial Examples in the Physical WorldYibo Miao, Yinpeng Dong, Jun Zhu, Xiao-Shan GaoNeurIPS 2022 · 45 citations
- A Critical Revisit of Adversarial Robustness in 3D Point Cloud Recognition with Diffusion-Driven PurificationJiachen Sun, Jiongxiao Wang, Weili Nie, Zhiding Yu et al.ICML 2023 · 24 citations
Builds on28
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 9,786 citations
- Distillation as a Defense to Adversarial Perturbations Against Deep Neural NetworksNicolas Papernot, Patrick D. McDaniel, Xi Wu, Somesh Jha et al.S&P 2016 · 3,275 citations
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacksFrancesco Croce, Matthias HeinICML 2020 · 2,337 citations
Related papers
- Robust Adversarial Objects against Deep Learning ModelsTzungyu Tsai, Kaichen Yang, Tsung-Yi Ho, Yier JinAAAI 2020 · 167 citations
- CausalPC: Improving the Robustness of Point Cloud Classification by Causal Effect IdentificationYuanmin Huang, Mi Zhang, Daizong Ding, Erling Jiang et al.CVPR 2024
- Robustness Certification for Point Cloud ModelsTobias Lorenz, Anian Ruoss, Mislav Balunovic, Gagandeep Singh et al.ICCV 2021 · 29 citations
- Ada3Diff: Defending against 3D Adversarial Point Clouds via Adaptive DiffusionKui Zhang, Hang Zhou, Jie Zhang, Qidong Huang et al.ACM MM 2023 · 14 citations
- Explicitly Perceiving and Preserving the Local Geometric Structures for 3D Point Cloud AttackDaizong Liu, Wei HuAAAI 2024 · 22 citations
