LLM Powered Text Entry Decoding and Flexible Typing on Smartphones
Yan Ma, Dan Zhang, I. V. Ramakrishnan, Xiaojun Bi
Abstract
decoder, and 95.4% on real-word tap typing data. In particular, our decoder supports Flexible Typing, allowing users to enter a word with taps, gestures, multi-stroke gestures, and tap-gesture combinations. User study results show that Flexible Typing is beneficial and well-received by participants, where 35.9% of words were entered using word gestures, 29.0% with taps, 6.1% with multi-stroke gestures, and the remaining 29.0% using tap-gestures. Our investigation suggests that the LLM-based decoder improves decoding accuracy over existing word gesture decoders while enabling the Flexible Typing method, which enhances the overall typing experience and accommodates diverse user preferences.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Accessible Gesture Typing on Smartphones for People with Low VisionDan Zhang, Zhi Li, Vikas Ashok, William H. Seiple et al.UIST 2024 · 4 citations
- Phrase-Gesture Typing on SmartphonesZheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong YangUIST 2022 · 4 citations
- From 2D to 3D: Facilitating Single-Finger Mid-Air Typing on QWERTY Keyboards with Probabilistic Touch ModelingXin Yi, Chen Liang, Haozhan Chen, Jiuxu Song et al.UbiComp 2023 · 11 citations
- Can Capacitive Touch Images Enhance Mobile Keyboard Decoding?Piyawat Lertvittayakumjorn, Shanqing Cai, Billy Dou, Cedric Ho et al.UIST 2024 · 1 citation
- DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU RingsChen Liang, Chi Hsia, Chun Yu, Yukang Yan et al.UbiComp 2023 · 33 citations
