HRTF Estimation in the Wild
Vivek Jayaram, Ira Kemelmacher-Shlizerman, Steven M. Seitz
Abstract
Head Related Transfer Functions (HRTFs) play a crucial role in creating immersive spatial audio experiences. However, HRTFs differ significantly from person to person, and traditional methods for estimating personalized HRTFs are expensive, time-consuming, and require specialized equipment. We imagine a world where your personalized HRTF can be determined by capturing data through earbuds in everyday environments. In this paper, we propose a novel approach for deriving personalized HRTFs that only relies on in-the-wild binaural recordings and head tracking data. By analyzing how sounds change as the user rotates their head through different environments with different noise sources, we can accurately estimate their personalized HRTF. Our results show that our predicted HRTFs closely match ground-truth HRTFs measured in an anechoic chamber. Furthermore, listening studies demonstrate that our personalized HRTFs significantly improve sound localization and reduce front-back confusion in virtual environments. Our approach offers an efficient and accessible method for deriving personalized HRTFs and has the potential to greatly improve spatial audio experiences.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab0709b1-c4ba-4c4b-aa95-b8d36abc825fCited by top-tier papers3
- Spatial Speech Translation: Translating Across Space With Binaural HearablesTuochao Chen, Qirui Wang, Runlin He, Shyamnath GollakotaCHI 2025 · 5 citations
- Multimodal Neural Acoustic Fields for Immersive Mixed RealityGuaneen Tong, Johnathan Chi-Ho Leung, Xi Peng, Haosheng Shi et al.IEEE VR 2025 · 4 citations
- Cyclic Learning for Binaural Audio Generation and LocalizationZhaojian Li, Bin Zhao, Yuan YuanCVPR 2024
Builds on2
Related papers
- Graph Neural Field with Spatial-Correlation Augmentation for HRTF PersonalizationDe Hu, Junsheng Hu, Cuicui JiangAAAI 2026
- AudioEar: Single-View Ear Reconstruction for Personalized Spatial AudioXiaoyang Huang, Yanjun Wang, Yang Liu, Bingbing Ni et al.AAAI 2023 · 5 citations
- TAS: Personalized Text-guided Audio SpatializationZhaojian Li, Bin Zhao, Yuan YuanACM MM 2024 · 4 citations
- VR360-SSL: Towards Accessible and Clinically-Viable 360° Sound Source Localization in Virtual RealityYihan Yin, Zhimin Wang, Ying Hu, Ke Zhang et al.UbiComp 2026
- Ear-AR: indoor acoustic augmented reality on earphonesZhijian Yang, Yu-Lin Wei, Sheng Shen, Romit Roy ChoudhuryMobiCom 2020 · 47 citations
