Lune

UIST2024Top-tier venue

SkipWriter: LLM-Powered Abbreviated Writing on Tablets

Zheer Xu, Shanqing Cai, Mukund Varma T., Subhashini Venugopalan, Shumin Zhai

Abstract

Large Language Models (LLMs) may offer transformative opportunities for text input, especially for physically demanding modalities like handwriting. We studied a form of abbreviated handwriting by designing, developing, and evaluating a prototype, named SkipWriter, that converts handwritten strokes of a variable-length prefix-based abbreviation (e.g., "ho a y" as handwritten strokes) into the intended full phrase (e.g., "how are you" in the digital format) based on the preceding context. SkipWriter consists of an in-production handwriting recognizer and an LLM fine-tuned on this task. With flexible pen input, SkipWriter allows the user to add and revise prefix strokes when predictions do not match the user’s intent. An user evaluation demonstrated a 60% reduction in motor movements with an average speed of 25.78 WPM. We also showed that this reduction is close to the ceiling of our model in an offline simulation.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

its abstract · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer CollaborationZheng Wei, Hongtao Wu, Lvmin Zhang, Xian Xu et al.UIST 2025 · 8 citations
  2. GestureCoach: Rehearsing for Engaging Talks with LLM-Driven Gesture RecommendationsAshwin Ram, Varsha Suresh, Artin Saberpour Abadian, Vera Demberg et al.UIST 2025 · 2 citations
  3. KeySense: LLM-Powered Hands-Down, Ten-Finger Typing on Commodity TouchscreensTony Li, Yan Ma, Zhuojun Li, Chun Yu et al.CHI 2026 · 1 citation

Related papers

  1. Accelerating Text Communication via Abbreviated Sentence InputJiban Adhikary, Jamie Berger, Keith VertanenACL 2021
  2. Supporting Text Entry in Virtual Reality with Large Language ModelsLiuqing Chen, Yu Cai, Ruyue Wang, Shixian Ding et al.IEEE VR 2024 · 18 citations
  3. Adapting Large Language Models for Character-based Augmentative and Alternative CommunicationDylan Gaines, Keith VertanenEMNLP Findings 2025 · 1 citation
  4. Phrase-Gesture Typing on SmartphonesZheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong YangUIST 2022 · 4 citations
  5. Write, Attend and Spell: Streaming End-to-end Free-style Handwriting Recognition Using SmartwatchesQian Zhang, Dong Wang, Run Zhao, Yinggang Yu et al.UbiComp 2021 · 14 citations
Dusk over the sea between two cliffs drawn in fine vertical lines