Wavesdropper: Through-wall Word Detection of Human Speech via Commercial mmWave Devices
Chao Wang, Feng Lin, Zhongjie Ba, Fan Zhang, Wenyao Xu, Kui Ren
Abstract
Most existing eavesdropping attacks leverage propagating sound waves for speech retrieval. However, soundproof materials are widely deployed in speech-sensitive scenes (e.g., a meeting room). In this paper, we reveal that human speech protected by an isolated room can be compromised by portable and commercial off-the-shelf mmWave devices. To achieve this goal, we develop Wavesdropper, a word detection system that utilizes a mmWave probe to sense the targeted speaker's throat vibration and recover speech contents in the obstructed condition. We proposed a CEEMD-based method to suppress dynamic clutters (e.g., human movements) in the room and a wavelet-based processing method to extract the delicate vocal vibration information from the hybrid signals. To recover speech contents from mmWave signals related to the vocal vibration, we designed a neural network to infer the speech contents. Moreover, we explored word detection on a conversation with multiple (two) probes and reveal that the adversary can detect words on multiple people simultaneously with only one mmWave device. We performed extensive experiments to evaluate the system performance with over 60,000 pronunciations. The experimental results indicate that Wavesdropper can achieve 91.3% accuracy for 57-word recognition on 23 volunteers.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get b00bef0c-66fb-40fa-9c5e-e623d9d34227Cited by top-tier papers14
- mSilent: Towards General Corpus Silent Speech Recognition Using COTS mmWave RadarShang Zeng, Haoran Wan, Shuyu Shi, Wei WangUbiComp 2023 · 34 citations
- Radio2Text: Streaming Speech Recognition Using mmWave Radio SignalsRunning Zhao, Jiangtao Yu, Hang Zhao, Edith C. H. NgaiUbiComp 2023 · 22 citations
- VibSpeech: Exploring Practical Wideband Eavesdropping via Bandlimited Signal of Vibration-based Side ChannelChao Wang, Feng Lin, Hao Yan, Tong Wu et al.USENIX Security 2024 · 16 citations
- Beamforming for Sensing: Hybrid Beamforming based on Transmitter-Receiver Collaboration for Millimeter-Wave SensingLong Fan, Lei Xie, Wenhui Zhou, Chuyu Wang et al.UbiComp 2024 · 13 citations
- EchoLight: Sound Eavesdropping based on Ambient Light ReflectionGuoming Zhang, Zhijie Xiang, Heqiang Fu, Yanni Yang et al.INFOCOM 2024 · 9 citations
Related papers
- mmPhone: Acoustic Eavesdropping on Loudspeakers via mmWave-characterized Piezoelectric EffectChao Wang, Feng Lin, Tiantian Liu, Ziwei Liu et al.INFOCOM 2022 · 46 citations
- mmEavesdropper: Signal Augmentation-based Directional Eavesdropping with mmWave RadarYiwen Feng, Kai Zhang, Chuyu Wang, Lei Xie et al.INFOCOM 2023 · 33 citations
- LAM-assisted Acoustic Eavesdropping in Multi-speaker Scenarios via Commercial mmWave RadarGuodong Liu, Lei Wang, Minjun Jiang, Qianran Qiao et al.UbiComp 2026
- mmEcho: A mmWave-based Acoustic Eavesdropping MethodPengfei Hu, Wenhao Li, Riccardo Spolaor, Xiuzhen ChengS&P 2023
- Privacy Leakage via Speech-induced Vibrations on Room Objects through Remote Sensing based on Phased-MIMOCong Shi, Tianfang Zhang, Zhaoyi Xu, Shuping Li et al.CCS 2023 · 10 citations
