Social Sensemaking with AI: Designing an Open-ended AI Experience with a Blind Child
Cecily Morrison, Edward Cutrell, Martin Grayson, Anja Thieme, Alex S. Taylor, Geert Roumen, Camilla Longden, Sebastian Tschiatschek, Rita Faia Marques, Abigail Sellen
Abstract
Research AI technologies are often used to aid people in performing discrete tasks with well-defined goals (e.g., recognising faces in images). Emerging technologies that provide continuous, real-time information enable more open-ended AI experiences. In partnership with a blind child, we explore the challenges and opportunities of designing human-AI interaction for a system intended to support social sensemaking. Adopting a research-through-design perspective, we reflect upon working with the uncertain capabilities of AI systems in the design of this experience. We contribute: (i) a concrete example of an open-ended AI system that enabled a blind child to extend his own capabilities; (ii) an illustration of the delta between imagined and actual use, highlighting how capabilities derive from the human-AI interaction and not the AI system alone; and (iii) a discussion of design choices to craft an ongoing human-AI interaction that addresses the challenge of uncertain outputs of AI systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d308520-cf05-44f0-b9a2-eff558c289a5Cited by top-tier papers5
- "The less I type, the better": How AI Language Models can Enhance or Impede Communication for AAC UsersStephanie Valencia, Richard Cave, Krystal Kallarackal, Katie Seaver et al.CHI 2023 · 92 citations
- Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for RadiologyNur Yildirim, Hannah Richardson, Maria Teodora Wetscherek, Junaid Bajwa et al.CHI 2024 · 81 citations
- Informing Age-Appropriate AI: Examining Principles and Practices of AI for ChildrenGe Wang, Jun Zhao, Max Van Kleek, Nigel ShadboltCHI 2022 · 73 citations
- Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-in-the-Loop LLMJiachen Li, Xiwen Li, Justin Steinberg, Akshat Choube et al.UbiComp 2025 · 9 citations
- Restoration, Exploration and Transformation: How Youth Engage Character.AI for Fun, Feels and Finding themselvesAnnabel Blake, Marcus Carter, Eduardo VellosoCHI 2026 · 4 citations
Builds on3
- Manipulating and Measuring Model InterpretabilityForough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan et al.CHI 2021 · 663 citations
- Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to DesignQian Yang, Aaron Steinfeld, Carolyn P. Rosé, John ZimmermanCHI 2020 · 604 citations
- The Care Work of AccessCynthia L. Bennett, Daniela K. Rosner, Alex S. TaylorCHI 2020 · 107 citations
Related papers
- Machine Eye: Designing Relational Engagement with Embodied Large Language ModelsAileen Ng, Nina Rajcic, Rowan PageCHI 2026 · 1 citation
- Everyday Uncertainty: How Blind People Use GenAI Tools for Information AccessXinru Tang, Ali Abdolrahmani, Darren Gergle, Anne Marie PiperCHI 2025 · 26 citations
- A11yExtensions: Accessibility Extensions to Augment Mobile AI Assistive Technology In-SituJaylin Herskovitz, Ellie Seehorn, Ather Jammoa, Jason Meddaugh et al.CHI 2026 · 1 citation
- Weaving Sound Information to Support Real-Time Sensemaking of Auditory Environments: Co-Designing with a DHH UserJeremy Zhengqi Huang, Jaylin Herskovitz, Liang-Yuan Wu, Cecily Morrison et al.CHI 2025 · 14 citations
- Researching AI Legibility through DesignJoseph Lindley, Haider Ali Akmal, Franziska Pilling, Paul CoultonCHI 2020 · 41 citations
