DRG-Keyboard: Enabling Subtle Gesture Typing on the Fingertip with Dual IMU Rings
Chen Liang, Chi Hsia, Chun Yu, Yukang Yan, Yuntao Wang, Yuanchun Shi
Abstract
We present DRG-Keyboard, a gesture keyboard enabled by dual IMU rings, allowing the user to swipe the thumb on the index fingertip to perform word gesture typing as if typing on a miniature QWERTY keyboard. With dual IMUs attached to the user's thumb and index finger, DRG-Keyboard can 1) measure the relative attitude while mapping it to the 2D fingertip coordinates and 2) detect the thumb's touch-down and touch-up events combining the relative attitude data and the synchronous frequency domain data, based on which a fingertip gesture keyboard can be implemented. To understand users typing behavior on the index fingertip with DRG-Keyboard, we collected and analyzed user data in two typing manners. Based on the statistics of the gesture data, we enhanced the elastic matching algorithm with rigid pruning and distance measurement transform. The user study showed DRG-Keyboard achieved an input speed of 12.9 WPM (68.3% of their gesture typing speed on the smartphone) for all participants. The appending study also demonstrated the superiority of DRG-Keyboard for better form factors and wider usage scenarios. To sum up, DRG-Keyboard not only achieves good text entry speed merely on a tiny fingertip input surface, but is also well accepted by the participants for the input subtleness, accuracy, good haptic feedback, and availability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fa76c0af-6818-4802-89ee-3250d424ad9dCited by top-tier papers10
- STAR: Smartphone-analogous Typing in Augmented RealityTaejun Kim, Amy Karlson, Aakar Gupta, Tovi Grossman et al.UIST 2023 · 26 citations
- TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionPaul Streli, Mark Richardson, Fadi Botros, Shugao Ma et al.UIST 2024 · 22 citations
- Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device SensingZisu Li, Chen Liang, Yuntao Wang, Yue Qin et al.CHI 2023 · 18 citations
- Understanding In-Situ Programming for Smart Home AutomationXiaoyi Liu, Yingtian Shi, Chun Yu, Cheng Gao et al.UbiComp 2023 · 17 citations
- ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionChen Liang, Xutong Wang, Zisu Li, Chi Hsia et al.UIST 2023 · 14 citations
Builds on10
- DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU RingsChen Liang, Chun Yu, Yue Qin, Yuntao Wang et al.UbiComp 2021 · 69 citations
- Ready, Steady, Touch!: Sensing Physical Contact with a Finger-Mounted IMUYilei Shi, Haimo Zhang, Kaixing Zhao, Jiashuo Cao et al.UbiComp 2020 · 52 citations
- QwertyRing: Text Entry on Physical Surfaces Using a RingYizheng Gu, Chun Yu, Zhipeng Li, Zhaoheng Li et al.UbiComp 2021 · 50 citations
- BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip KeyboardZheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo et al.CHI 2020 · 48 citations
- TAGSwipe: Touch Assisted Gaze Swipe for Text EntryChandan Kumar, Ramin Hedeshy, I. Scott MacKenzie, Steffen StaabCHI 2020 · 41 citations
Related papers
- TapType: Ten-finger text entry on everyday surfaces via Bayesian inferencePaul Streli, Jiaxi Jiang, Andreas Rene Fender, Manuel Meier et al.CHI 2022 · 48 citations
- BackSwipe: Back-of-device Word-Gesture Interaction on SmartphonesWenzhe Cui, Suwen Zhu, Zhi Li, Zheer Xu et al.CHI 2021 · 17 citations
- From 2D to 3D: Facilitating Single-Finger Mid-Air Typing on QWERTY Keyboards with Probabilistic Touch ModelingXin Yi, Chen Liang, Haozhan Chen, Jiuxu Song et al.UbiComp 2023 · 11 citations
- SwEYEpinch and Beyond: Exploring Intuitive, Efficient Text Entry for Extended Reality via Eye and Hand TrackingZiheng 'Leo' Li, Xichen He, Mengyuan Wu, Zeyi Tong et al.CHI 2026 · 1 citation
- LLM Powered Text Entry Decoding and Flexible Typing on SmartphonesYan Ma, Dan Zhang, I. V. Ramakrishnan, Xiaojun BiCHI 2025 · 1 citation
