Ninja Hands: Using Many Hands to Improve Target Selection in VR
Jonas Schjerlund, Kasper Hornbæk, Joanna Bergström
Abstract
Selection and manipulation in virtual reality often happen using an avatar’s hands. However, objects outside the immediate reach require effort to select. We develop a target selection technique called Ninja Hands. It maps the movement of a single real hand to many virtual hands, decreasing the distance to targets. We evaluate Ninja Hands in two studies. The first study shows that compared to a single hand, 4 and 8 hands are significantly faster for selecting targets. The second study complements this finding by using a larger target layout with many distractors. We find no decrease in selection time across 8, 27, and 64 hands, but an increase in the time spent deciding which hand to use. Thereby, net movement time still decreases significantly. In both studies, the physical motion exerted also decreases significantly with more hands. We discuss how these findings can inform future implementations of the Ninja Hands technique.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers16
- When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceTeresa Hirzle, Florian Müller, Fiona Draxler, Martin Schmitz et al.CHI 2023 · 90 citations
- Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual RealityParastoo Abtahi, Sidney Q. Hough, James A. Landay, Sean FollmerCHI 2022 · 60 citations
- FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined SpacesWen-Jie Tseng, Samuel Huron, Eric Lecolinet, Jan GugenheimerCHI 2023 · 41 citations
- There Is No First- or Third-Person View in Virtual Reality: Understanding the Perspective ContinuumMatthias Hoppe, Andrea Baumann, Patrick Chofor Tamunjoh, Tonja-Katrin Machulla et al.CHI 2022 · 37 citations
- Optimizing the Timing of Intelligent Suggestion in Virtual RealityDifeng Yu, Ruta Desai, Ting Zhang, Hrvoje Benko et al.UIST 2022 · 22 citations
Related papers
- NinjaPort: A Multi-Hand Approach for VR TeleportationBakdauren Narbayev, Patricia Lasserre, Khalad HasanIEEE VR 2026
- Hitchhiking Hands: Enabling "Virtually Direct" VR Manipulation by Switching Multiple Hand Avatars with GazeReigo Ban, Keigo Matsumoto, Takuji NarumiCHI 2026 · 2 citations
- Iteratively Adapting Avatars using Task-Integrated OptimisationJess McIntosh, Hubert Dariusz Zajac, Andreea Nicoleta Stefan, Joanna Bergström et al.UIST 2020 · 19 citations
- A Faster VR Body to Speed Up ChoicesDifeng Yu, Joanna Bergström, Kasper HornbækCHI 2026 · 1 citation
- Effect of Hand and Object Visibility in Navigational Tasks Based on Rotational and Translational Movements in Virtual RealityAmal Hatira, Zeynep Ecem Gelmez, Anil Ufuk Batmaz, Mine SaracIEEE VR 2024 · 9 citations
