Spatial Haptics: A Sensory Substitution Method for Distal Object Detection Using Tactile Cues
Iddo Yehoshua Wald, Donald Degraen, Amber Maimon, Jonas Keppel, Stefan Schneegass, Rainer Malaka
Abstract
We present a sensory substitution-based method for representing locations of remote objects in 3D space via haptics. By imitating auditory localization processes, we enable vibrotactile localization abilities similar to those of some spiders, elephants, and other species. We evaluated this concept in virtual reality by modulating the vibration amplitude of two controllers depending on relative locations to a target. We developed two implementations applying this method using either ear or hand locations. A proof-of-concept study assessed localization performance and user experience, achieving under 30° differentiation between horizontal targets with no prior training. This unique approach enables localization by using only two actuators, requires low computational power, and could potentially assist users in gaining spatial awareness in challenging environments. We compare the implementations and discuss the use of hands as ears in motion, a novel technique not previously explored in the sensory substitution literature.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers2
- Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMsArata Jingu, Easa AliAbbasi, Sara Safaee, Paul Strohmeier et al.CHI 2026 · 4 citations
- How are Vibrotactile Experiences Visually Represented? A Taxonomy of Illustration CharacteristicsBruno Fruchard, Dennis Wittchen, Nihar Sabnis, Paul Strohmeier et al.CHI 2026 · 1 citation
Related papers
- Head Up Visualization of Spatial Sound Sources in Virtual Reality for Deaf and Hard-of-Hearing PeopleMohammadreza Mirzaei, Peter Kán, Hannes KaufmannIEEE VR 2021 · 11 citations
- EarVR: Using Ear Haptics in Virtual Reality for Deaf and Hard-of-Hearing PeopleMohammadreza Mirzaei, Peter Kán, Hannes KaufmannIEEE VR 2020 · 73 citations
- Multi-modal Spatial Object Localization in Virtual Reality for Deaf and Hard-of-Hearing PeopleMohammadreza Mirzaei, Peter Kán, Hannes KaufmannIEEE VR 2021 · 17 citations
- Comparing Vibrotactile and Skin-Stretch Haptic Feedback for Conveying Spatial Information of Virtual Objects to Blind VR UsersJiasheng Li, Zining Zhang, Zeyu Yan, Yuhang Zhao et al.IEEE VR 2025 · 3 citations
- Exploring Bimanual Haptic Feedback for Spatial Search in Virtual RealityBoyu Gao, Tong Shao, Huawei Tu, Qizi Ma et al.IEEE VR 2024 · 10 citations
