AnkleType: A Hands- and Eyes-free Foot-based Text Entry Technique in Virtual Reality
Xiyun Luo, Weirong Luo, Kening Zhu, Taizhou Chen
Abstract
Virtual Reality (VR) emphasizes immersive experiences, while text entry often requires hands or visual attention, which may disrupt the interaction flows in VR. We present AnkleType, a hand- and eye-free text-entry technique that leverages ankle-based gestures for both standing and sitting situations. We began with two preliminary studies: one investigated the movement range of users' ankles, and the other elicited user-preferred ankle gestures for text-entry-related operations. The findings of these two studies guided our design of AnkleType. To optimize AnkleType's keyboard layout for eye-free input, we conducted a user study to capture the users' natural ankle spatial awareness with a computer-simulated language test. Through a pairwise comparison study, we designed a bipedal input strategy for sitting (BPSit) and a unipedal input strategy for standing (UPStand). Our first in-VR text-entry evaluation with 16 participants demonstrated that our methods could support the average typing speed from 8.99 WPM (BPSit) to 9.13 WPM (UPStand) for our first-time users. We further evaluated our design with a 7-day longitudinal study with twelve participants. Participants achieved an average typing speed of 15.05 WPM with UPStand and 16.70 WPM with BPSit in the visual condition, and 11.15 WPM and 12.87 WPM, respectively in the eyes-free condition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d2bcb4c4-efec-44d0-8bae-8a0ec8109518Builds on25
- Text Entry in Virtual Environments using Speech and a Midair KeyboardJiban Adhikary, Keith VertanenIEEE VR 2021 · 59 citations
- iText: Hands-free Text Entry on an Imaginary Keyboard for Augmented Reality SystemsXueshi Lu, Difeng Yu, Hai-Ning Liang, Jorge GonçalvesUIST 2021 · 54 citations
- BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip KeyboardZheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo et al.CHI 2020 · 48 citations
- GestOnHMD: Enabling Gesture-based Interaction on Low-cost VR Head-Mounted DisplayTaizhou Chen, Lantian Xu, Xianshan Xu, Kening ZhuIEEE VR 2021 · 42 citations
- Blended Whiteboard: Physicality and Reconfigurability in Remote Mixed Reality CollaborationJens Emil Sloth Grønbæk, Juan Sánchez Esquivel, Germán Leiva, Eduardo Velloso et al.CHI 2024 · 41 citations
Related papers
- Exploration of Foot-based Text Entry Techniques for Virtual Reality EnvironmentsTingjie Wan, Liangyuting Zhang, Hongyu Yang, Pourang Irani et al.CHI 2024 · 13 citations
- TapGazer: Text Entry with Finger Tapping and Gaze-directed Word SelectionZhenyi He, Christof Lutteroth, Ken PerlinCHI 2022 · 24 citations
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier et al.CHI 2022 · 48 citations
- FanType: Intention-Inferring Fan-Shaped Thumb Interface for Text Entry on Small XR KeyboardsGuanghan Zhao, Louis Teys, Gyeonghwan Yang, Shengdong Zhao et al.IEEE VR 2026
- Seeing and Touching the Air: Unraveling Eye-Hand Coordination in Mid-Air Gesture Typing for Mixed RealityJinghui Hu, John J. Dudley, Per Ola KristenssonCHI 2025 · 3 citations
