Hearing Without Noticing? Attention-Aware Stealthy Black-Box Adversarial Audio Attacks
Tianyi Xu, Cheng'an Wei, Yue Zhao, Kai Chen
Abstract
Automatic Speech Recognition (ASR) systems, such as those in intelligent assistants, are vulnerable to adversarial examples (AEs). Benign audio clips like music, when embedded with small perturbations, can trick ASR models into recognizing attacker-specified commands. Prior studies focus on minimizing perturbation magnitude to craft AEs. However, they fails to achieve high attack stealthiness against black-box ASR systems in the physical world. In this paper, we introduce the first music carrier selection algorithm and an attention-aware stealthiness loss function to generate stealthy AEs. Extensive evaluations on five commercial ASR APIs and three widely-used voice assistants demonstrate that our method significantly outperforms state-of-the-art techniques in both effectiveness and stealthiness. Notably, in a user study involving 200 participants, 55.6% of participants perceived our physical adversarial examples as benign audio, which is an improvement of over 20% compared to existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 50585f05-4ff9-4ad2-bb64-0feb6a6d4f38Builds on11
- Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
- AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed GradientsJuntang Zhuang, Tommy Tang, Yifan Ding, Sekhar Tatikonda et al.NeurIPS 2020 · 697 citations
- CommanderSong: A Systematic Approach for Practical Adversarial Voice RecognitionXuejing Yuan, Yuxuan Chen, Yue Zhao, Yunhui Long et al.USENIX Security 2018 · 389 citations
- Practical Hidden Voice Attacks against Speech and Speaker Recognition SystemsHadi Abdullah, Washington Garcia, Christian Peeters, Patrick Traynor et al.NDSS 2019 · 180 citations
- Black-box Adversarial Attacks on Commercial Speech Platforms with Minimal InformationBaolin Zheng, Peipei Jiang, Qian Wang, Qi Li et al.CCS 2021 · 73 citations
Related papers
- EvilHarmony: Stealthy Adversarial Attacks Against Black-Box Speech Recognition SystemsXuejing Yuan, Jiangshan Zhang, Feng Guo, Kai Chen et al.S&P 2025
- KENKU: Towards Efficient and Stealthy Black-box Adversarial Attacks against ASR SystemsXinghui Wu, Shiqing Ma, Chao Shen, Chenhao Lin et al.USENIX Security 2023
- Inaudible Adversarial Perturbation: Manipulating the Recognition of User Speech in Real TimeXinfeng Li, Chen Yan, Xuancun Lu, Zihan Zeng et al.NDSS 2024
- Devil's Whisper: A General Approach for Physical Adversarial Attacks against Commercial Black-box Speech Recognition DevicesYuxuan Chen, Xuejing Yuan, Jiangshan Zhang, Yue Zhao et al.USENIX Security 2020
- ALIF: Low-Cost Adversarial Audio Attacks on Black-Box Speech Platforms using Linguistic FeaturesPeng Cheng, Yuwei Wang, Peng Huang, Zhongjie Ba et al.S&P 2024 · 16 citations
