Detecting Temporal Misalignment Attacks in Multimodal Fusion for Autonomous Driving
Md Hasan Shahriar, Md Mohaimin Al Barat, Harshavardhan Sundar, Ning Zhang, Naren Ramakrishnan, Y. Thomas Hou, Wenjing Lou
摘要
Multimodal fusion (MMF) is crucial for autonomous driving perception, combining camera and LiDAR streams for reliable scene understanding. However, its reliance on precise temporal synchronization introduces a vulnerability: adversaries can exploit network-induced delays to subtly misalign sensor streams, degrading MMF performance. To address this, we propose AION, a lightweight, plug-in defense tailored for the autonomous driving scenario. AION integrates continuity-aware contrastive learning to learn smooth multimodal representations and a DTW-based detection mechanism to trace temporal alignment paths and generate misalignment scores. AION demonstrates strong and consistent robustness against a wide range of temporal misalignment attacks on KITTI and nuScenes, achieving high average AUROC for camera-only (0.9493) and LiDAR-only (0.9495) attacks, while sustaining robust performance under joint cross-modal attacks (0.9195 on most attacks) with low false-positive rates across fusion backbones. Code is available at: https://github.com/shahriar0651/AION.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- On the (In)Security of Secure ROS2Gelei Deng, Guowen Xu, Yuan Zhou, Tianwei Zhang 等CCS 2022 · 被引用 31 次
- PhyScout: Detecting Sensor Spoofing Attacks via Spatio-temporal ConsistencyYuan Xu, Gelei Deng, Xingshuo Han, Guanlin Li 等CCS 2024 · 被引用 2 次
- nuScenes: A Multimodal Dataset for Autonomous DrivingHolger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora 等CVPR 2020
- That Person Moves Like A Car: Misclassification Attack Detection for Autonomous Systems Using Spatiotemporal ConsistencyYanmao Man, Raymond Muller, Ming Li, Z. Berkay Celik 等USENIX Security 2023
- On the Realism of LiDAR Spoofing Attacks against Autonomous Driving Vehicle at High Speed and Long DistanceTakami Sato, Ryo Suzuki, Yuki Hayakawa, Kazuma Ikeda 等NDSS 2025
相关 Paper
- Fusion Is Not Enough: Single Modal Attacks on Fusion Models for 3D Object DetectionZhiyuan Cheng, Hongjun Choi, Shiwei Feng, James Chenhao Liang 等ICLR 2024 · 被引用 32 次
- Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World AttacksYulong Cao, Ningfei Wang, Chaowei Xiao, Dawei Yang 等S&P 2021 · 被引用 309 次
- Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous VehiclesR. Spencer Hallyburton, Yupei Liu, Yulong Cao, Z. Morley Mao 等USENIX Security 2022
- Multi-view Correlation based Black-box Adversarial Attack for 3D Object DetectionBingyu Liu, Yuhong Guo, Jianan Jiang, Jian Tang 等KDD 2021 · 被引用 10 次
- Malicious Attacks against Multi-Sensor Fusion in Autonomous DrivingYi Zhu, Chenglin Miao, Hongfei Xue, Yunnan Yu 等MobiCom 2024 · 被引用 28 次
