PrivacyMic: Utilizing Inaudible Frequencies for Privacy Preserving Daily Activity Recognition
Yasha Iravantchi, Karan Ahuja, Mayank Goel, Chris Harrison, Alanson P. Sample
Abstract
Sound presents an invaluable signal source that enables computing systems to perform daily activity recognition. However, microphones are optimized for human speech and hearing ranges: capturing private content, such as speech, while omitting useful, inaudible information that can aid in acoustic recognition tasks. We simulated acoustic recognition tasks using sounds from 127 everyday household/workplace objects, finding that inaudible frequencies can act as a substitute for privacy-sensitive frequencies. To take advantage of these inaudible frequencies, we designed a Raspberry Pi-based device that captures inaudible acoustic frequencies with settings that can remove speech or all audible frequencies entirely. We conducted a perception study, where participants “eavesdropped’’ on PrivacyMic’s filtered audio and found that none of our participants could transcribe speech. Finally, PrivacyMic’s real-world activity recognition performance is comparable to our simulated results, with over 95% classification accuracy across all environments, suggesting immediate viability in performing privacy-preserving daily activity recognition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- PowerPhone: Unleashing the Acoustic Sensing Capability of SmartphonesShirui Cao, Dong Li, Sunghoon Ivan Lee, Jie XiongMobiCom 2023 · 35 citations
- Peekaboo: A Hub-Based Approach to Enable Transparency in Data Processing within Smart HomesHaojian Jin, Gram Liu, David Hwang, Swarun Kumar et al.S&P 2022 · 25 citations
- ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Wave Around the BodySaif Mahmud, Vineet Parikh, Qikang Liang, Ke Li et al.UbiComp 2025 · 24 citations
- FlowSense: Monitoring Airflow in Building Ventilation Systems Using Audio SensingBhawana Chhaglani, Camellia Zakaria, Adam Lechowicz, Jeremy Gummeson et al.UbiComp 2022 · 22 citations
- Opportunities in Mental Health Support for Informal Dementia Caregivers Suffering from Verbal AgitationTaewook Kim, Hyeok Kim, Angela C. Roberts, Maia L. Jacobs et al.CSCW 2024 · 14 citations
Builds on1
Related papers
- Kirigami: Lightweight Speech Filtering for Privacy-Preserving Activity Recognition using AudioSudershan Boovaraghavan, Haozhe Zhou, Mayank Goel, Yuvraj AgarwalUbiComp 2024 · 7 citations
- SAMoSA: Sensing Activities with Motion and Subsampled AudioVimal Mollyn, Karan Ahuja, Dhruv Verma, Chris Harrison et al.UbiComp 2022 · 54 citations
- Ok Google, What Am I Doing?: Acoustic Activity Recognition Bounded by Conversational Assistant InteractionsRebecca Adaimi, Howard Yong, Edison ThomazUbiComp 2021 · 29 citations
- Hard Drive of Hearing: Disks that Eavesdrop with a Synthesized MicrophoneAndrew Kwong, Wenyuan Xu, Kevin FuS&P 2019 · 63 citations
- Leveraging Sound and Wrist Motion to Detect Activities of Daily Living with Commodity SmartwatchesSarnab Bhattacharya, Rebecca Adaimi, Edison ThomazUbiComp 2022 · 41 citations
