Typist Experiment: an Investigation of Human-to-Human Dictation via Role-play to Inform Voice-based Text Authoring
Can Liu, Siying Hu, Li Feng, Mingming Fan
Abstract
Voice dictation is increasingly used for text entry, especially in mobile scenarios. However, the speech-based experience gets disrupted when users must go back to a screen and keyboard to review and edit the text. While existing dictation systems focus on improving transcription and error correction, little is known about how to support speech input for the entire text creation process, including composition, reviewing and editing. We conducted an experiment in which ten pairs of participants took on the roles of authors and typists to work on a text authoring task. By analysing the natural language patterns of both authors and typists, we identified new challenges and opportunities for the design of future dictation interfaces, including the ambiguity of human dictation, the differences between audio-only and with screen, and various passive and active assistance that can potentially be provided by future systems.
CCS Concepts: • Human-centered computing → Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d5114842-42c8-4ecb-bc8d-204cbc29c6f6Cited by top-tier papers1
Ask how each one uses itBuilds on5
- EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual InputDebjyoti Ghosh, Pin Sym Foong, Shengdong Zhao, Can Liu et al.CHI 2020 · 42 citations
- Writing Strategies for Science Communication: Data and Computational AnalysisTal August, Lauren Kim, Katharina Reinecke, Noah A. SmithEMNLP 2020 · 22 citations
- Just Speak It: Minimize Cognitive Load for Eyes-Free Text Editing with a Smart Voice AssistantJiayue Fan, Chenning Xu, Chun Yu, Yuanchun ShiUIST 2021 · 17 citations
- Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for SmartphonesMaozheng Zhao, Wenzhe Cui, I. V. Ramakrishnan, Shumin Zhai et al.UIST 2021 · 17 citations
- Comparing Smartphone Speech Recognition and Touchscreen Typing for Composition and TranscriptionMargaret Jean Foley, Géry Casiez, Daniel VogelCHI 2020 · 13 citations
Related papers
- Desirable Unfamiliarity: Insights from Eye Movements on Engagement and Readability of Dictation InterfacesZhaohui Liang, Yonglin Chen, Naser Al Madi, Can LiuCHI 2026 · 1 citation
- StepWrite: Adaptive Planning for Speech-Driven Text GenerationHamza El Alaoui, Atieh Taheri, Yi-Hao Peng, Jeffrey P. BighamUIST 2025 · 2 citations
- Enhancing the Composition Task in Text Entry Studies: Eliciting Difficult Text and Improving Error Rate CalculationDylan Gaines, Per Ola Kristensson, Keith VertanenCHI 2021 · 13 citations
- Toward Interactive DictationBelinda Z. Li, Jason Eisner, Adam Pauls, Sam ThomsonACL 2023 · 2 citations
- Identifying an Aurally Distinct Phrase Set for Text Entry TechniquesJacob Abbott, Jofish Kaye, James ClawsonCHI 2022 · 3 citations
