texSketch: Active Diagramming through Pen-and-Ink Annotations
Hariharan Subramonyam, Colleen M. Seifert, Priti Shah, Eytan Adar
Abstract
Learning from text is a constructive activity in which sentence-level information is combined by the reader to build coherent mental models. With increasingly complex texts, forming a mental model becomes challenging due to a lack of background knowledge, and limits in working memory and attention. To address this, we are taught knowledge externalization strategies such as active reading and diagramming. Unfortunately, paper-and-pencil approaches may not always be appropriate, and software solutions create friction through difficult input modalities, limited workflow support, and barriers between reading and diagramming. For all but the simplest text, building coherent diagrams can be tedious and difficult. We propose Active Diagramming, an approach extending familiar active reading strategies to the task of diagram construction. Our prototype, texSketch, combines pen-and-ink interactions with natural language processing to reduce the cost of producing diagrams while maintaining the cognitive effort necessary for comprehension. Our user study finds that readers can effectively create diagrams without disrupting reading.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 970bcd7e-5331-4a1d-98d8-7d357d6a8ccdCited by top-tier papers14
- Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMsHariharan Subramonyam, Roy Pea, Christopher Lawrence Pondoc, Maneesh Agrawala et al.CHI 2024 · 137 citations
- Beyond Text Generation: Supporting Writers with Continuous Automatic Text SummariesHai Dang, Karim Benharrak, Florian Lehmann, Daniel BuschekUIST 2022 · 84 citations
- Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific LiteratureHyeonsu B. Kang, Joseph Chee Chang, Yongsung Kim, Aniket KitturUIST 2022 · 48 citations
- Passages: Interacting with Text Across DocumentsHan L. Han, Junhang Yu, Raphael Bournet, Alexandre Ciorascu et al.CHI 2022 · 36 citations
- Charagraph: Interactive Generation of Charts for Realtime Annotation of Data-Rich ParagraphsDamien Masson, Sylvain Malacria, Géry Casiez, Daniel VogelCHI 2023 · 35 citations
Related papers
- From Words to Structured Visuals: A Benchmark and Framework for Text-to-Diagram Generation and EditingJingxuan Wei, Cheng Tan, Qi Chen, Gaowei Wu et al.CVPR 2025
- Graphologue: Exploring Large Language Model Responses with Interactive DiagramsPeiling Jiang, Jude Rayan, Steven P. Dow, Haijun XiaUIST 2023 · 135 citations
- Sketchnote Components, Design Space Dimensions, and Strategies for Effective Visual Note TakingRebecca Zheng, Marina Fernández Camporro, Hugo Romat, Nathalie Henry Riche et al.CHI 2021 · 19 citations
- Diagram2Structure: Unlocking LLMs' Diagram Comprehension through DiagramDiff, a Framework for Structuring Offline DiagramsHaoxiang Hu, Yaokun Li, Zeyuan Huang, Cangjun Gao et al.CVPR 2026
- How Domain Experts Create Conceptual Diagrams and Implications for Tool DesignDor Ma'ayan, Wode Ni, Katherine Ye, Chinmay Kulkarni et al.CHI 2020 · 19 citations
