Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
Nur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg, Fernanda B. Viégas
Abstract
Articial intelligence (AI) presents new challenges for the user experience (UX) of products and services. Recently, practitionerfacing resources and design guidelines have become available to ease some of these challenges. However, little research has investigated if and how these guidelines are used, and how they impact practice. In this paper, we investigated how industry practitioners use the People + AI Guidebook. We conducted interviews with 31 practitioners (i.e., designers, product managers) to understand how they use human-AI guidelines when designing AI-enabled products. Our ndings revealed that practitioners use the guidebook not only for addressing AI's design challenges, but also for education, cross-functional communication, and for developing internal resources. We uncovered that practitioners desire more support for early phase ideation and problem formulation to avoid AI product failures. We discuss the implications for future resources aiming to help practitioners in designing AI products.
• Human-centered computing ! Interaction design process and methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9cc6c289-e1ca-48e5-9a24-d2d2133341c1Cited by top-tier papers27
- Design Principles for Generative AI ApplicationsJustin D. Weisz, Jessica He, Michael J. Muller, Gabriela Hoefer et al.CHI 2024 · 221 citations
- Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for RadiologyNur Yildirim, Hannah Richardson, Maria Teodora Wetscherek, Junaid Bajwa et al.CHI 2024 · 81 citations
- Farsight: Fostering Responsible AI Awareness During AI Application PrototypingZijie J. Wang, Chinmay Kulkarni, Lauren Wilcox, Michael Terry et al.CHI 2024 · 55 citations
- The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder, Early-stage Deliberations Around Public Sector AI ProposalsAnna Kawakami, Amanda Coston, Haiyi Zhu, Hoda Heidari et al.CHI 2024 · 54 citations
- Guidelines for Integrating Value Sensitive Design in Responsible AI ToolkitsMalak Sadek, Marios Constantinides, Daniele Quercia, Céline MougenotCHI 2024 · 49 citations
Builds on17
- Questioning the AI: Informing Design Practices for Explainable AI User ExperiencesQ. Vera Liao, Daniel M. Gruen, Sarah MillerCHI 2020 · 758 citations
- Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AIMichael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, Hanna M. WallachCHI 2020 · 428 citations
- Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative ModelsRyan Louie, Andy Coenen, Cheng Zhi Huang, Michael Terry et al.CHI 2020 · 265 citations
- Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for SupportMichael Madaio, Lisa Egede, Hariharan Subramonyam, Jennifer Wortman Vaughan et al.CSCW 2022 · 149 citations
- How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case StudyDavid Piorkowski, Soya Park, April Yi Wang, Dakuo Wang et al.CSCW 2021 · 142 citations
Related papers
- 'It Is Not Always Discovery Time': Four Pragmatic Approaches in Designing AI SystemsMaximiliane Windl, Sebastian S. Feger, Lara Zijlstra, Albrecht Schmidt et al.CHI 2022 · 26 citations
- Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI ChallengesQiaosi Wang, Michael Madaio, Shaun K. Kane, Shivani Kapania et al.CHI 2023 · 90 citations
- Coordination Mechanisms in AI Development: Practitioner Experiences on Integrating UX ActivitiesAnders Bruun, Niels van Berkel, Dimitrios Raptis, Effie L.-C. LawCHI 2025 · 2 citations
- Planning for Natural Language Failures with the AI PlaybookMatthew K. Hong, Adam Fourney, Derek DeBellis, Saleema AmershiCHI 2021 · 54 citations
- Unpacking Practitioners' Attitudes Towards Codifications of Design Knowledge for Voice User InterfacesKrishika Haresh Khemani, Stuart ReevesCHI 2022 · 4 citations
