Simulating Errors in Touchscreen Typing
Danqing Shi, Yujun Zhu, Francisco Erivaldo Fernandes Junior, Shumin Zhai, Antti Oulasvirta
Abstract
Empirical evidence shows that typing on touchscreen devices is prone to errors and that correcting them poses a major detriment to users' performance. Design of text entry systems that better serve users, across their broad capability range, necessitates understanding the cognitive mechanisms that underpin these errors. However, prior models of typing cover only motor slips. The paper reports on extending the scope of computational modeling of typing to cover the cognitive mechanisms behind the three main types of error: slips (inaccurate execution), lapses (forgetting), and mistakes (incorrect knowledge). Given a phrase, a keyboard, and user parameters, Typoist simulates eye and finger movements while making human-like insertion, omission, substitution, and transposition errors. Its main technical contribution is the formulation of a supervisory control problem wherein the controller allocates cognitive resources to detect and fix errors generated by the various mechanisms. The model generates predictions of typing performance that can inform design, for better text entry systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Evaluating Robustness of Large Language Models Against Multilingual Typographical ErrorsRaoyuan Zhao, Yihong Liu, Lena Altinger, Hinrich Schütze et al.ACL 2026 · 6 citations
- Log2Motion: Biomechanical Motion Synthesis from Touch LogsMichal Patryk Miazga, Hannah Bussmann, Antti Oulasvirta, Patrick EbelCHI 2026 · 2 citations
- Benchmarking Visual LLMs Resilience to Unanswerable Questions on Visually Rich DocumentsDavide Napolitano, Luca Cagliero, Fabrizio BattiloroAAAI 2026
Builds on7
- Implementation Matters in Deep RL: A Case Study on PPO and TRPOLogan Engstrom, Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras et al.ICLR 2020 · 305 citations
- Computational Rationality as a Theory of InteractionAntti Oulasvirta, Jussi P. P. Jokinen, Andrew HowesCHI 2022 · 127 citations
- Touchscreen Typing As Optimal Supervisory ControlJussi Jokinen, Aditya Acharya, Mohammad Uzair, Xinhui Jiang et al.CHI 2021 · 105 citations
- How We Type: Eye and Finger Movement Strategies in Mobile TypingXinhui Jiang, Yang Li, Jussi P. P. Jokinen, Viet Ba Hirvola et al.CHI 2020 · 36 citations
- CRTypist: Simulating Touchscreen Typing Behavior via Computational RationalityDanqing Shi, Yujun Zhu, Jussi P. P. Jokinen, Aditya Acharya et al.CHI 2024 · 26 citations
Related papers
- Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson's DiseaseYuntao Wang, Ao Yu, Xin Yi, Yuanwei Zhang et al.CHI 2021 · 11 citations
- Decoding Surface Touch Typing from Hand-TrackingMark Richardson, Matt Durasoff, Robert WangUIST 2020 · 40 citations
- Platform for Studying Self-Repairing Auto-Corrections in Mobile Text Entry based on Brain Activity, Gaze, and ContextFelix Putze, Tilman Ihrig, Tanja Schultz, Wolfgang StuerzlingerCHI 2020 · 10 citations
- How We Type with Word Suggestions: Understanding Visual Attention and Checking Behavior during Mobile Text InputYang Li, Anna Maria FeitUbiComp 2025 · 3 citations
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier et al.CHI 2022 · 48 citations
