Hands-free interaction in immersive virtual reality: A systematic review
Pedro Monteiro, Guilherme Gonçalves, Hugo Coelho, Miguel Melo, Maximino Bessa
Abstract
Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 79 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Privacy-Preserving Gaze Data Streaming in Immersive Interactive Virtual Reality: Robustness and User ExperienceEthan Wilson, Azim Ibragimov, Michael J. Proulx, Sai Deep Tetali et al.IEEE VR 2024 · 30 citations
- Orient Anything V2: Unifying Orientation and Rotation UnderstandingZehan Wang, Ziang Zhang, Jiayang Xu, Jialei Wang et al.NeurIPS 2025 · 24 citations
- Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle ContractionYunxiang Zhang, Kenneth Chen, Qi SunSIGGRAPH 2023 · 14 citations
- Robust Dual-Modal Speech Keyword Spotting for XR HeadsetsZhuojiang Cai, Yuhan Ma, Feng LuIEEE VR 2024 · 8 citations
- HandProxy: Expanding the Affordances of Speech Interfaces in Immersive Environments with a Virtual Proxy HandChen Liang, Yuxuan Liu, Martez E. Mott, Anhong GuoUbiComp 2025 · 3 citations
Builds on2
Related papers
- Radi-Eye: Hands-Free Radial Interfaces for 3D Interaction using Gaze-Activated Head-CrossingLudwig Sidenmark, Dominic Potts, Bill Bapisch, Hans GellersenCHI 2021 · 49 citations
- GazePuffer: Hands-Free Input Method Leveraging Puff Cheeks for VRYunfei Lai, Minghui Sun, Zhuofeng LiIEEE VR 2024 · 8 citations
- Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive InteractionsSiyou Pei, Alexander Chen, Jaewook Lee, Yang ZhangCHI 2022 · 93 citations
- Gaze-Supported 3D Object Manipulation in Virtual RealityDifeng Yu, Xueshi Lu, Rongkai Shi, Hai-Ning Liang et al.CHI 2021 · 116 citations
- TicTacToes: Assessing Toe Movements as an Input ModalityFlorian Müller, Daniel Schmitt, Andrii Matviienko, Dominik Schön et al.CHI 2023 · 21 citations
