To Reuse or Not To Reuse?: A Framework and System for Evaluating Summarized Knowledge
Michael Xieyang Liu, Aniket Kittur, Brad A. Myers
Abstract
As the amount of information online continues to grow, a correspondingly important opportunity is for individuals to reuse knowledge which has been summarized by others rather than starting from scratch. However, appropriate reuse requires judging the relevance, trustworthiness, and thoroughness of others' knowledge in relation to an individual's goals and context. In this work, we explore augmenting judgements of the appropriateness of reusing knowledge in the domain of programming, specifically of reusing artifacts that result from other developers' searching and decision making. Through an analysis of prior research on sensemaking and trust, along with new interviews with developers, we synthesized a framework for reuse judgements. The interviews also validated that developers express a desire for help with judging whether to reuse an existing decision. From this framework, we developed a set of techniques for capturing the initial decision maker's behavior and visualizing signals calculated based on the behavior, to facilitate subsequent consumers' reuse decisions, instantiated in a prototype system called Strata. Results of a user study suggest that the system significantly improves the accuracy, depth, and speed of reusing decisions. These results have implications for systems involving user-generated content in which other users need to evaluate the relevance and trustworthiness of that content.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers17
- "What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language ModelsMichael Xieyang Liu, Advait Sarkar, Carina Negreanu, Benjamin G. Zorn et al.CHI 2023 · 114 citations
- Wigglite: Low-cost Information Collection and TriageMichael Xieyang Liu, Andrew Kuznetsov, Yongsung Kim, Joseph Chee Chang et al.UIST 2022 · 62 citations
- Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language ModelsMichael Xieyang Liu, Tongshuang Wu, Tianying Chen, Franklin Mingzhe Li et al.CHI 2024 · 44 citations
- An Exploration of Captioning Practices and Challenges of Individual Content Creators on YouTube for People with Hearing ImpairmentsFranklin Mingzhe Li, Cheng Lu, Zhicong Lu, Patrick Carrington et al.CSCW 2022 · 34 citations
- Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision MakingMichael Xieyang Liu, Aniket Kittur, Brad A. MyersCHI 2022 · 31 citations
Builds on4
- Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented DialogsToby Jia-Jun Li, Jingya Chen, Haijun Xia, Tom M. Mitchell et al.UIST 2020 · 98 citations
- Mesh: Scaffolding Comparison Tables for Online Decision MakingJoseph Chee Chang, Nathan Hahn, Aniket KitturUIST 2020 · 32 citations
- ScreenTrack: Using a Visual History of a Computer Screen to Retrieve Documents and Web PagesDonghan Hu, Sang Won LeeCHI 2020 · 18 citations
- Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration SystemsToby Jia-Jun Li, Jingya Chen, Brandon Canfield, Brad A. MyersCSCW 2020 · 5 citations
Related papers
- An Exploratory Study of Sharing Strategic Programming KnowledgeMaryam Arab, Thomas D. LaToza, Jenny T. Liang, Amy J. KoCHI 2022 · 10 citations
- TRACTUS: Understanding and Supporting Source Code Experimentation in Hypothesis-Driven Data ScienceKrishna Subramanian, Johannes Maas, Jan O. BorchersCHI 2020 · 14 citations
- Designing SocialTrust.md to Enhance Developer Awareness of Risks in Utilizing Open-Source GitHub RepositoriesTony W. Li, Yunpeng Zhao, Yujin Zhang, R. Stuart Geiger et al.CSCW 2026
- From Conversation to Human-AI Common Ground: Extracting Cognitive Workflows for Reuse in Sense-making TasksXinyue Chen, Varun Manjunatha, Xu Wang, Alexa F. SiuCHI 2026 · 1 citation
- Characterizing search activities on stack overflowJiakun Liu, Sebastian Baltes, Christoph Treude, David Lo et al.FSE 2021 · 16 citations
