TypeAnywhere: A QWERTY-Based Text Entry Solution for Ubiquitous Computing
Mingrui Ray Zhang, Shumin Zhai, Jacob O. Wobbrock
Abstract
We present a QWERTY-based text entry system, TypeAnywhere, for use in off-desktop computing environments. Using a wearable device that can detect finger taps, users can leverage their touch-typing skills from physical keyboards to perform text entry on any surface. TypeAnywhere decodes typing sequences based only on finger-tap sequences without relying on tap locations. To achieve optimal decoding performance, we trained a neural language model and achieved a 1.6% character error rate (CER) in an offline evaluation, compared to a 5.3% CER from a traditional n-gram language model. Our user study showed that participants achieved an average performance of 70.6 WPM, or 80.4% of their physical keyboard speed, and 1.50% CER after 2.5 hours of practice over five days on a table surface. They also achieved 43.9 WPM and 1.37% CER when typing on their laps. Our results demonstrate the strong potential of QWERTY typing as a ubiquitous text entry solution.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4c329adf-3b90-49a5-a4d5-b727a573ca52Cited by top-tier papers10
- STAR: Smartphone-analogous Typing in Augmented RealityTaejun Kim, Amy Karlson, Aakar Gupta, Tovi Grossman et al.UIST 2023 · 26 citations
- TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionPaul Streli, Mark Richardson, Fadi Botros, Shugao Ma et al.UIST 2024 · 22 citations
- GlassMessaging: Towards Ubiquitous Messaging Using OHMDsNuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao et al.UbiComp 2023 · 21 citations
- ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionChen Liang, Xutong Wang, Zisu Li, Chi Hsia et al.UIST 2023 · 14 citations
- StegoType: Surface Typing from Egocentric CamerasMark Richardson, Fadi Botros, Yangyang Shi, Pinhao Guo et al.UIST 2024 · 10 citations
Builds on10
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- QwertyRing: Text Entry on Physical Surfaces Using a RingYizheng Gu, Chun Yu, Zhipeng Li, Zhaoheng Li et al.UbiComp 2021 · 50 citations
- BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip KeyboardZheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo et al.CHI 2020 · 48 citations
- Decoding Surface Touch Typing from Hand-TrackingMark Richardson, Matt Durasoff, Robert WangUIST 2020 · 40 citations
Related papers
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier et al.CHI 2022 · 48 citations
- TapGazer: Text Entry with Finger Tapping and Gaze-directed Word SelectionZhenyi He, Christof Lutteroth, Ken PerlinCHI 2022 · 24 citations
- FineType: Fine-grained Tapping Gesture Recognition for Text EntryChentao Li, Ziheng Xi, Jianjiang Feng, Jie ZhouCHI 2025 · 5 citations
- Phrase-Gesture Typing on SmartphonesZheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong YangUIST 2022 · 4 citations
- From 2D to 3D: Facilitating Single-Finger Mid-Air Typing on QWERTY Keyboards with Probabilistic Touch ModelingXin Yi, Chen Liang, Haozhan Chen, Jiuxu Song et al.UbiComp 2023 · 11 citations
