SafeSpeaker: Voice Obfuscation for Resource-Constrained IoT Devices
Cameron Haire, Yasha Iravantchi, Kang G. Shin, Alanson P. Sample
Abstract
Embodied voice assistants offer an intuitive and powerful interaction modality, but they also pose significant privacy-leakage risks when uploading raw voice recordings to the cloud for processing. These voice recordings contain a wealth of private information beyond just spoken content, such as acoustic features that can be used to identify and track users. Existing privacy-protection approaches either rely on encryption and cloud-side processing (leaving raw audio exposed in transit and storage) or use voice obfuscation algorithms whose compute and memory demands exceed what microcontroller-class IoT devices can sustain in real time. As a result, the most resource-constrained microphone-enabled devices, which are also among the most numerous, lack any practical voice privacy protection. We present SafeSpeaker , a lightweight voice obfuscation framework that closes this gap by running entirely on the edge device that captures the audio, breaking the link between user identity and speech before any recording leaves the device. SafeSpeaker uses a time-domain, formant-approximate transformation that avoids the frequency-domain transforms used by prior DSP-based approaches, processing audio nearly 2× faster while matching the identity-obfuscation performance (equal error rate) of state-of-the-art resource-aware methods. We demonstrate the practicality of this design with a real-time prototype on a $3 Arm Cortex-M4 microcontroller that sits between a microphone and an off-the-shelf smart speaker while maintaining the usability to understand and respond to voice commands. By making voice obfuscation feasible at this hardware tier, SafeSpeaker extends on-device voice privacy protections to a substantially larger class of microphone-enabled smart devices.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 50d0fa38-8977-4830-b99f-3b4761602f92Related papers
- Hey Kimya, Is My Smart Speaker Spying on Me? Taking Control of Sensor Privacy Through Isolation and AmnesiaPiet De Vaere, Adrian PerrigUSENIX Security 2023
- SILENCE: Protecting privacy in offloaded speech understanding on resource-constrained devicesDongqi Cai, Shangguang Wang, Zeling Zhang, Felix Xiaozhu Lin et al.NeurIPS 2024 · 2 citations
- Privacy against Real-Time Speech Emotion Detection via Acoustic Adversarial Evasion of Machine LearningBrian Testa, Yi Xiao, Harshit Sharma, Avery Gump et al.UbiComp 2023 · 12 citations
- Preech: A System for Privacy-Preserving Speech TranscriptionShimaa Ahmed, Amrita Roy Chowdhury, Kassem Fawaz, Parmesh RamanathanUSENIX Security 2020
- MicPro: Microphone-based Voice Privacy ProtectionShilin Xiao, Xiaoyu Ji, Chen Yan, Zhicong Zheng et al.CCS 2023 · 6 citations
