Voice localization using nearby wall reflections
Sheng Shen, Daguan Chen, Yu-Lin Wei, Zhijian Yang, Romit Roy Choudhury
Abstract
Voice assistants such as Amazon Echo (Alexa) and Google Home use microphone arrays to estimate the angle of arrival (AoA) of the human voice. This paper focuses on adding user localization as a new capability to voice assistants. For any voice command, we desire Alexa to be able to localize the user inside the home. The core challenge is two-fold: (1) accurately estimating the AoAs of multipath echoes without the knowledge of the source signal, and (2) tracing back these AoAs to reverse triangulate the user's location.
We develop VoLoc, a system that proposes an iterative align-andcancel algorithm for improved multipath AoA estimation, followed by an error-minimization technique to estimate the geometry of a nearby wall reflection. The AoAs and geometric parameters of the nearby wall are then fused to reveal the user's location. Under modest assumptions, we report localization accuracy of 0.44 m across different rooms, clutter, and user/microphone locations. VoLoc runs in near real-time but needs to hear around 15 voice commands before becoming operational.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3ce97889-df66-495e-8773-12fcb54cee3dCited by top-tier papers13
- Ear-AR: indoor acoustic augmented reality on earphonesZhijian Yang, Yu-Lin Wei, Sheng Shen, Romit Roy ChoudhuryMobiCom 2020 · 47 citations
- MAVL: Multiresolution Analysis of Voice LocalizationMei Wang, Wei Sun, Lili QiuNSDI 2021 · 46 citations
- RespTracker: Multi-user Room-scale Respiration Tracking with Commercial Acoustic DevicesHaoran Wan, Shuyu Shi, Wenyu Cao, Wei Wang et al.INFOCOM 2021 · 37 citations
- Personalizing head related transfer functions for earablesZhijian Yang, Romit Roy ChoudhurySIGCOMM 2021 · 26 citations
- Acoustic Sensing and Communication Using MetasurfaceYongzhao Zhang, Yezhou Wang, Lanqing Yang, Mei Wang et al.NSDI 2023 · 25 citations
Related papers
- Separating Voices from Multiple Sound Sources using 2D Microphone ArrayXinran Lu, Lei Xie, Fang Wang, Tao Gu et al.INFOCOM 2022 · 2 citations
- Model-based Head Orientation Estimation for Smart DevicesQiang Yang, Yuanqing ZhengUbiComp 2021 · 18 citations
- WSTrack: A Wi-Fi and Sound Fusion System for Device-free Human TrackingYichen Tian, Yunliang Wang, Ruikai Zheng, Xiulong Liu et al.INFOCOM 2023 · 25 citations
- Direction-of-Voice (DoV) Estimation for Intuitive Speech Interaction with Smart Devices EcosystemsKaran Ahuja, Andy Kong, Mayank Goel, Chris HarrisonUIST 2020 · 29 citations
- Ok Google, What Am I Doing?: Acoustic Activity Recognition Bounded by Conversational Assistant InteractionsRebecca Adaimi, Howard Yong, Edison ThomazUbiComp 2021 · 29 citations
