Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge Capture
Rebecca Krosnick, Fraser Anderson, Justin Matejka, Steve Oney, Walter S. Lasecki, Tovi Grossman, George W. Fitzmaurice
Abstract
When users complete tasks on the computer, the knowledge they leverage and their intent is often lost because it is tedious or challenging to capture. This makes it harder to understand why a colleague designed a component a certain way or to remember requirements for software you wrote a year ago. We introduce think-aloud computing, a novel application of the think-aloud protocol where computer users are encouraged to speak while working to capture rich knowledge with relatively low effort. Through a formative study we find people shared information about design intent, work processes, problems encountered, to-do items, and other useful information. We developed a prototype that supports think-aloud computing by prompting users to speak and contextualizing speech with labels and application context. Our evaluation shows more subtle design decisions and process explanations were captured in think-aloud than via traditional documentation. Participants reported that think-aloud required similar effort as traditional documentation.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 524e416d-14de-4931-bb55-7ad7fd40c4a9Cited by top-tier papers7
- PANDALens: Towards AI-Assisted In-Context Writing on OHMD During TravelsRunze Cai, Nuwan Janaka, Yang Chen, Lucia J. Wang et al.CHI 2024 · 36 citations
- Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage TutorialsApril Yi Wang, Andrew Head, Ashley Ge Zhang, Steve Oney et al.CHI 2023 · 11 citations
- Retrospector: Rapid collaborative reflection to improve collaborative practicesSoya Park, Chinmay KulkarniCSCW 2023 · 7 citations
- ClearFairy: Capturing Creative Workflows through Decision Structuring, In-Situ Questioning, and Rationale InferenceKihoon Son, DaEun Choi, Tae Soo Kim, Young-Ho Kim et al.CHI 2026 · 1 citation
- PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud ComputingFrederic Gmeiner, John Thompson, George W. Fitzmaurice, Justin MatejkaCHI 2026 · 1 citation
Related papers
- Lost in Translation: The Value of Verbalizations in Interpreting 3D Computer-Aided Design WorkflowsKathy Cheng, Jo Vermeulen, George W. Fitzmaurice, Justin MatejkaCHI 2026 · 1 citation
- Crowdsourced Think-Aloud StudiesZach Cutler, Lane Harrison, Carolina Nobre, Alexander LexCHI 2025 · 4 citations
- Agentic Audio Moderator vs Human Moderator in Think-Aloud Usability Testing: Results from a Randomized Controlled Trial: Results from a Randomized Controlled TrialWangda Zhu, Guang Chen, Yao Wang, Pengcheng An et al.CHI 2026 · 1 citation
- From Conversation to Human-AI Common Ground: Extracting Cognitive Workflows for Reuse in Sense-making TasksXinyue Chen, Varun Manjunatha, Xu Wang, Alexa F. SiuCHI 2026 · 1 citation
- Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience ProblemsMingming Fan, Qiwen Zhao, Vinita TibdewalCHI 2021 · 28 citations
