NavStick: Making Video Games Blind-Accessible via the Ability to Look Around
Vishnu Nair, Jay L. Karp, Samuel Silverman, Mohar Kalra, Hollis Lehv, Faizan Jamil, Brian A. Smith
Abstract
Video games remain largely inaccessible to visually impaired people (VIPs). Today's blind-accessible games are highly simplified renditions of what sighted players enjoy, and they do not give VIPs the same freedom to look around and explore game worlds on their own terms. In this work, we introduce NavStick, an audio-based tool for looking around within virtual environments, with the aim of making 3D adventure video games more blind-accessible. Nav-Stick repurposes a game controller's thumbstick to allow VIPs to survey what is around them via line-of-sight. In a user study, we compare NavStick with traditional menu-based surveying for different navigation tasks and find that VIPs were able to form more accurate mental maps of their environment with NavStick than with menu-based surveying. In an additional exploratory study, we investigate NavStick in the context of a representative 3D adventure game. Our findings reveal several implications for blind-accessible games, and we close by discussing these.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5e4f6b0a-4b45-49a3-99c7-450ea2751863Cited by top-tier papers15
- "My Zelda Cane": Strategies Used by Blind Players to Play Visual-Centric Digital GamesDavid Gonçalves, Manuel Piçarra, Pedro Pais, João Guerreiro et al.CHI 2023 · 36 citations
- OmniScribe: Authoring Immersive Audio Descriptions for 360° VideosRuei-Che Chang, Chao-Hsien Ting, Chia-Sheng Hung, Wan-Chen Lee et al.UIST 2022 · 32 citations
- The Design Space of the Auditory Representation of Objects and Their Behaviours in Virtual Reality for Blind PeopleJoão Guerreiro, Yujin Kim, Rodrigo Nogueira, Seung A. Chung et al.IEEE VR 2023 · 32 citations
- ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision UsersVishnu Nair, Hanxiu 'Hazel' Zhu, Brian A. SmithCHI 2023 · 26 citations
- "I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual ImpairmentsGaurav Jain, Yuanyang Teng, Dong Heon Cho, Yunhao Xing et al.CSCW 2023 · 23 citations
Builds on1
Related papers
- Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual WorldsAlexa F. Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek et al.CHI 2020 · 115 citations
- Surveyor: Facilitating Discovery Within Video Games for Blind and Low Vision PlayersVishnu Nair, Hanxiu 'Hazel' Zhu, Peize Song, Jizhong Wang et al.CHI 2024 · 14 citations
- Virtual Worlds Beyond Sight: Designing and Evaluating an Audio-Haptic System for Non-Visual VR ExplorationAayush Shrestha, Joseph MallochCHI 2025 · 6 citations
- From Selfie Stick to Virtual Cane: Enabling Blind Exploration through Mobile Virtual RealityHao Tang, Hong Zhao, Xinpeng Liu, Zhenchao Xia et al.CHI 2026
- Exploring Audio Interfaces for Vertical Guidance in Augmented Reality via Hand-Based FeedbackRenan Guarese, Emma Pretty, Aidan Renata, Deb Polson et al.IEEE VR 2024 · 10 citations
