Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual Worlds
Alexa F. Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, Edward Cutrell
Abstract
Current Virtual Reality (VR) technologies focus on rendering visuospatial effects, and thus are inaccessible for blind or low vision users. We examine the use of a novel white cane controller that enables navigation without vision of large virtual environments with complex architecture, such as winding paths and occluding walls and doors. The cane controller employs a lightweight three-axis brake mechanism to provide large-scale shape of virtual objects. The multiple degrees-of-freedom enables users to adapt the controller to their preferred techniques and grip. In addition, surface textures are rendered with a voice coil actuator based on contact vibrations; and spatialized audio is determined based on the progression of sound through the geometry around the user. We design a scavenger hunt game that demonstrates how our device enables blind users to navigate a complex virtual environment. Seven out of eight users were able to successfully navigate the virtual room (6x6m) to locate targets while avoiding collisions. We conclude with design consideration on creating immersive non-visual VR experiences based on user preferences for cane techniques, and cane material properties.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext caec0689-2f65-42e3-9014-8651c50f20a3Cited by top-tier papers18
- Haptic PIVOT: On-Demand Handhelds in VRRobert Kovacs, Eyal Ofek, Mar González-Franco, Alexa Fay Siu et al.UIST 2020 · 91 citations
- bARefoot: Generating Virtual Materials using Motion Coupled Vibration in ShoesPaul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea et al.UIST 2020 · 69 citations
- Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual RealityParastoo Abtahi, Sidney Q. Hough, James A. Landay, Sean FollmerCHI 2022 · 60 citations
- The Impact of Navigation Aids on Search Performance and Object Recall in Wide-Area Augmented RealityRadha Kumaran, You-Jin Kim, Anne E. Milner, Tom Bullock et al.CHI 2023 · 39 citations
- "My Zelda Cane": Strategies Used by Blind Players to Play Visual-Centric Digital GamesDavid Gonçalves, Manuel Piçarra, Pedro Pais, João Guerreiro et al.CHI 2023 · 36 citations
Related papers
- Virtual Worlds Beyond Sight: Designing and Evaluating an Audio-Haptic System for Non-Visual VR ExplorationAayush Shrestha, Joseph MallochCHI 2025 · 6 citations
- From Selfie Stick to Virtual Cane: Enabling Blind Exploration through Mobile Virtual RealityHao Tang, Hong Zhao, Xinpeng Liu, Zhenchao Xia et al.CHI 2026
- Comparing Vibrotactile and Skin-Stretch Haptic Feedback for Conveying Spatial Information of Virtual Objects to Blind VR UsersJiasheng Li, Zining Zhang, Zeyu Yan, Yuhang Zhao et al.IEEE VR 2025 · 3 citations
- NavStick: Making Video Games Blind-Accessible via the Ability to Look AroundVishnu Nair, Jay L. Karp, Samuel Silverman, Mohar Kalra et al.UIST 2021 · 46 citations
- The Design Space of the Auditory Representation of Objects and Their Behaviours in Virtual Reality for Blind PeopleJoão Guerreiro, Yujin Kim, Rodrigo Nogueira, Seung A. Chung et al.IEEE VR 2023 · 32 citations
