BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones
Wenzhe Cui, Suwen Zhu, Zhi Li, Zheer Xu, Xing-Dong Yang, I. V. Ramakrishnan, Xiaojun Bi
Abstract
Back-of-device interaction is a promising approach to interacting on smartphones. In this paper, we create a back-of-device command and text input technique called BackSwipe, which allows a user to hold a smartphone with one hand, and use the index finger of the same hand to draw a word-gesture anywhere at the back of the smartphone to enter commands and text. To support BackSwipe, we propose a back-of-device word-gesture decoding algorithm which infers the keyboard location from back-of-device gestures, and adjusts the keyboard size to suit the gesture scales; the inferred keyboard is then fed back into the system for decoding. Our user study shows BackSwipe is feasible and a promising input method, especially for command input in the one-hand holding posture: users can enter commands at an average accuracy of 92% with a speed of 5.32 seconds/command. The text entry performance varies across users. The average speed is 9.58 WPM with some users at 18.83 WPM; the average word error rate is 11.04% with some users at 2.85%. Overall, BackSwipe complements the extant smartphone interaction by leveraging the back of the device as a gestural input surface.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on TouchscreensZhi Li, Maozheng Zhao, Dibyendu Das, Hang Zhao et al.CHI 2022 · 10 citations
- Tilt-Explore: Making Tilt Gestures Usable for Low-Vision Smartphone UsersFarhani Momotaz, Syed Masum BillahUIST 2021 · 7 citations
Builds on1
Related papers
- Phrase-Gesture Typing on SmartphonesZheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong YangUIST 2022 · 4 citations
- DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU RingsChen Liang, Chi Hsia, Chun Yu, Yukang Yan et al.UbiComp 2023 · 33 citations
- TAGSwipe: Touch Assisted Gaze Swipe for Text EntryChandan Kumar, Ramin Hedeshy, I. Scott MacKenzie, Steffen StaabCHI 2020 · 41 citations
- SwEYEpinch and Beyond: Exploring Intuitive, Efficient Text Entry for Extended Reality via Eye and Hand TrackingZiheng 'Leo' Li, Xichen He, Mengyuan Wu, Zeyi Tong et al.CHI 2026 · 1 citation
- BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip KeyboardZheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo et al.CHI 2020 · 48 citations
