ECHO: Efficient Head-Orientation-Guided Real-Time Sound Spatialization for Virtual Reality
Haiyu Wang, Tianhua Xia, Sai Qian Zhang
摘要
Immersive virtual reality (VR) experiences depend on the seamless coordination of visual and auditory feedback under tight latency constraints. While decades of research have refined real-time graphics pipelines, low-latency sound spatialization remains computationally intensive and relatively underexplored, despite its equal importance to user presence. Auditory perception is highly sensitive to head orientation, environmental acoustics, and timing precision. On compact, resource-limited head-mounted displays (HMDs), the heavy computational workload often causes spatial audio to lag behind visual rendering, degrading perceptual realism and user comfort. We present ECHO, an efficient head-orientation-guided framework for real-time sound spatialization that leverages natural head dynamics to reduce redundant computation. ECHO dynamically combines audio sources based on the listener's orientation and co-optimizes head pose estimation algorithms with hardware for low-latency performance. Integrated as a plug-in within VR HMD SoCs, ECHO achieves up to lower sound spatialization latency while maintaining high-fidelity auditory realism across diverse acoustic environments.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Perceptually-Guided Acoustic "Foveation"Xi Peng, Kenneth Chen, Iran Roman, Juan Pablo Bello 等IEEE VR 2025 · 被引用 2 次
- Auptimize: Optimal Placement of Spatial Audio Cues for Extended RealityHyunsung Cho, Alexander Wang, Divya Kartik, Emily Liying Xie 等UIST 2024 · 被引用 19 次
- Impact of Visual Virtual Scene and Localization Task on Auditory Distance Perception in Virtual RealitySarah Roßkopf, Andreas Mühlberger, Felix Stärz, Steven van de Par 等IEEE VR 2025 · 被引用 6 次
- EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual RealityHaojie Cheng, Shaun Jing Heng Ong, Shaoyu Cai, Aiden Tat Yang Koh 等IEEE VR 2026 · 被引用 1 次
- Sonic4D: Spatial Audio Generation for Immersive 4D Scene ExplorationSiyi Xie, Hanxin Zhu, Xinyi Chen, Tianyu He 等AAAI 2026 · 被引用 4 次
