KeySense: LLM-Powered Hands-Down, Ten-Finger Typing on Commodity Touchscreens
Tony Li, Yan Ma, Zhuojun Li, Chun Yu, I. V. Ramakrishnan, Xiaojun Bi
摘要
Existing touchscreen software keyboards prevent users from resting their hands, forcing slow and fatiguing index-finger tapping (“chicken typing”) instead of familiar hands-down ten-finger typing. We present KeySense, a purely software solution that preserves physical keyboard motor skills. KeySense isolates intentional taps from resting-finger noise with cognitive–motor timing patterns, and then uses a fine-tuned LLM decoder to turn the resulting noisy letter sequence into the intended word. In controlled component tests, this decoder substantially outperforms 2 statistical baselines (top-1 accuracy 84.8% vs 75.7% and 79.3%). A 12-participant study shows clear ergonomic and performance benefits: compared with the conventional hover-style keyboard, users rated KeySense as markedly less physically demanding (NASA-TLX median 1.5 vs 4.0), and after brief practice, typed significantly faster (WPM 28.3 vs 26.2, p <0.01). These results indicate that KeySense enables accurate, efficient and comfortable ten-finger text entry on commodity touchscreens, without any extra hardware.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu 等ICLR 2022 · 被引用 4,966 次
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier 等CHI 2022 · 被引用 48 次
- Decoding Surface Touch Typing from Hand-TrackingMark Richardson, Matt Durasoff, Robert WangUIST 2020 · 被引用 40 次
- GlanceWriter: Writing Text by Glancing Over Letters with GazeWenzhe Cui, Rui Liu, Zhi Li, Yifan Wang 等CHI 2023 · 被引用 28 次
相关 Paper
- LLM Powered Text Entry Decoding and Flexible Typing on SmartphonesYan Ma, Dan Zhang, I. V. Ramakrishnan, Xiaojun BiCHI 2025 · 被引用 1 次
- Can Capacitive Touch Images Enhance Mobile Keyboard Decoding?Piyawat Lertvittayakumjorn, Shanqing Cai, Billy Dou, Cedric Ho 等UIST 2024 · 被引用 1 次
- TypeAnywhere: A QWERTY-Based Text Entry Solution for Ubiquitous ComputingMingrui Ray Zhang, Shumin Zhai, Jacob O. WobbrockCHI 2022 · 被引用 27 次
- ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersZhuojun Li, Chun Yu, Yizheng Gu, Yuanchun ShiCHI 2023 · 被引用 6 次
- PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text EntryXin Yi, Chen Wang, Xiaojun Bi, Yuanchun ShiCHI 2020 · 被引用 14 次
