Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks
Zhiyuan Cheng, James Liang, Guanhong Tao, Dongfang Liu, Xiangyu Zhang
Abstract
Monocular Depth Estimation (MDE) is a critical component in applications such as autonomous driving. There are various attacks against MDE networks. These attacks, especially the physical ones, pose a great threat to the security of such systems. Traditional adversarial training method requires ground-truth labels hence cannot be directly applied to self-supervised MDE that does not have ground-truth depth. Some self-supervised model hardening techniques (e.g., contrastive learning) ignore the domain knowledge of MDE and can hardly achieve optimal performance. In this work, we propose a novel adversarial training method for self-supervised MDE models based on view synthesis without using ground-truth depth. We improve adversarial robustness against physical-world attacks using L0-norm-bounded perturbation in training. We compare our method with supervised learning based and contrastive learning based methods that are tailored for MDE. Results on two representative MDE networks show that we achieve better robustness against various adversarial attacks with nearly no benign performance degradation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5f6c1b2a-eb06-47d8-a5c8-69e47d09e72eCited by top-tier papers9
- Visual Recognition with Deep Nearest CentroidsWenguan Wang, Cheng Han, Tianfei Zhou, Dongfang LiuICLR 2023 · 45 citations
- Fusion Is Not Enough: Single Modal Attacks on Fusion Models for 3D Object DetectionZhiyuan Cheng, Hongjun Choi, Shiwei Feng, James Chenhao Liang et al.ICLR 2024 · 32 citations
- Mitigating the Curse of Dimensionality for Certified Robustness via Dual Randomized SmoothingSong Xia, Yi Yu, Xudong Jiang, Henghui DingICLR 2024 · 18 citations
- BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression TasksZhiyuan Cheng, Zhaoyi Liu, Tengda Guo, Shiwei Feng et al.ICML 2024 · 10 citations
- Prototypical Transformer As Unified Motion LearnersCheng Han, Yawen Lu, Guohao Sun, James Chenhao Liang et al.ICML 2024 · 9 citations
Builds on25
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 9,786 citations
- Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacksFrancesco Croce, Matthias HeinICML 2020 · 2,337 citations
- Adversarial Sensor Attack on LiDAR-based Perception in Autonomous DrivingYulong Cao, Chaowei Xiao, Benjamin Cyr, Yimeng Zhou et al.CCS 2019 · 626 citations
- Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World AttacksYulong Cao, Ningfei Wang, Chaowei Xiao, Dawei Yang et al.S&P 2021 · 309 citations
Related papers
- pi-Jack: Physical-World Adversarial Attack on Monocular Depth Estimation with Perspective HijackingTianyue Zheng, Jingzhi Hu, Rui Tan, Yinqian Zhang et al.USENIX Security 2024 · 8 citations
- Targeted Adversarial Perturbations for Monocular Depth PredictionAlex Wong, Safa Cicek, Stefano SoattoNeurIPS 2020 · 61 citations
- Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous DrivingJunhao Zheng, Chenhao Lin, Jiahao Sun, Zhengyu Zhao et al.CVPR 2024 · 36 citations
- Beware of Road Markings: A New Adversarial Patch Attack to Monocular Depth EstimationHangcheng Liu, Zhenhu Wu, Hao Wang, Xingshuo Han et al.NeurIPS 2024 · 13 citations
- V2Depth: Monocular Depth Estimation via Feature-Level Virtual-View Simulation and RefinementZizhang Wu, Zhuozheng Li, Zhi-Gang Fan, Yunzhe Wu et al.ACM MM 2023 · 4 citations
