Lune

UbiComp2026Top-tier venue

VR360-SSL: Towards Accessible and Clinically-Viable 360° Sound Source Localization in Virtual Reality

Yihan Yin, Zhimin Wang, Ying Hu, Ke Zhang, Feng Lu

2026Year

Abstract

Sound source localization (SSL) capability serves as a crucial indicator of early hearing impairment, with applications in hearing disorder diagnosis, hearing aid fitting, and neurodegenerative disease screening. However, traditional SSL testing requires expensive professional equipment (over $500,000) and dedicated soundproof facilities (over 30 m 2 ), significantly limiting accessibility for large-scale screening programs. While VR-based systems offer a promising alternative, they face fundamental challenges when extending to full 360° scenarios, particularly severe confusion between front and rear sound sources and interaction fatigue for rear target selection. To address these limitations, we propose the VR360-SSL system, the first 360° VR-based screening and rehabilitation tracking tool. Our approach introduces a frequency domain enhancement strategy for non-individualized head-related transfer functions that perceptually compensates for front-back ambiguity by reinforcing high-frequency cues for front sources and enhancing low-frequency components for rear sources. We further incorporate adaptive interaction modalities (eye gaze and hand gesture) with pre-experiment assessment that matches interaction modes to users' VR experience and spatial imagination abilities. Preliminary experiments with 32 participants (including 23 normal hearing (NH) individuals and 9 single-sided deafness (SSD) patients) indicate that the system provides localization trends consistent with real sound field environments and successfully identifies performance gradients across different hearing impairment severities. Front-back confusion rates were significantly reduced to levels comparable with real-world medical setups. By reducing costs to a single VR headset, our system enables SSL testing expansion from specialized clinics to primary care and community-based screening scenarios, particularly suitable for VR-naive elderly populations and resource-limited areas.

Ask about this paper

Ask your agent about it.

Lune has read the top-tier papers around this one, so every answer names the papers it rests on.

Questions to start from

Your agent calls

Lunesearch_papers

Ask in Lune

Free to start. No credit card required.

lune papers get 89536012-4e0c-444f-86b6-b0164786c3c5

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines