USENIX Security2024Top-tier venue
Can I Hear Your Face? Pervasive Attack on Voice Authentication Systems with a Single Face Image
Nan Jiang, Bangjie Sun, Terence Sim, Jun Han
Abstract
We present Foice, a novel deepfake attack against voice authentication systems. Foice generates a synthetic voice of the victim from just a single image of the victim's face, without requiring any voice sample. This synthetic voice is realistic enough to fool commercial authentication systems. Since face images are generally easier to obtain than voice samples, Foice effectively makes it easier for an attacker to mount large-scale attacks. The key idea lies in learning the partial correlation between face and voice features, and adding to that a face-independent voice feature sampled from a Gaussian distribution. We demonstrate the effectiveness of Foice with a comprehensive set of real-world experiments involving ten offline participants and an online dataset of 1,029 unique individuals. By evaluating eight state-of-the-art systems, including WeChat's Voiceprint and Microsoft Azure, we show that all these systems are vulnerable to Foice attack.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2519026e-0ff9-4d32-9d75-fee3a2e41dc3Cited by top-tier papers1
Ask how each one uses itBuilds on12
- CommanderSong: A Systematic Approach for Practical Adversarial Voice RecognitionXuejing Yuan, Yuxuan Chen, Yue Zhao, Yunhui Long et al.USENIX Security 2018 · 389 citations
- Who is Real Bob? Adversarial Attacks on Speaker Recognition SystemsGuangke Chen, Sen Chen, Lingling Fan, Xiaoning Du et al.S&P 2021 · 239 citations
- "Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real WorldEmily Wenger, Max Bronckers, Christian Cianfarani, Jenna Cryan et al.CCS 2021 · 36 citations
- Face-based Voice Conversion: Learning the Voice behind a FaceHsiao-Han Lu, Shao-En Weng, Ya-Fan Yen, Hong-Han Shuai et al.ACM MM 2021 · 15 citations
- What Does Your Face Sound Like? 3D Face Shape towards VoiceZhihan Yang, Zhiyong Wu, Ying Shan, Jia JiaAAAI 2023 · 6 citations
Related papers
- Am I a Real or Fake Celebrity? Evaluating Face Recognition and Verification APIs under Deepfake Impersonation AttackShahroz Tariq, Sowon Jeon, Simon S. WooWWW 2022 · 33 citations
- From One Stolen Utterance: Assessing the Risks of Voice Cloning in the AIGC EraKun Wang, Meng Chen, Li Lu, Jingwen Feng et al.S&P 2025
- Voiceprint Mimicry Attack Towards Speaker Verification System in Smart HomeLei Zhang, Yan Meng, Jiahao Yu, Chong Xiang et al.INFOCOM 2020 · 49 citations
- rtCaptcha: A Real-Time CAPTCHA Based Liveness Detection SystemErkam Uzun, Simon Pak Ho Chung, Irfan Essa, Wenke LeeNDSS 2018 · 60 citations
- DepthFake: Spoofing 3D Face Authentication with a 2D PhotoZhihao Wu, Yushi Cheng, Jiahui Yang, Xiaoyu Ji et al.S&P 2023
