A study of UX practitioners roles in designing real-world, enterprise ML systems
Sabah Zdanowska, Alex S. Taylor
Abstract
Opportunities for AI and machine learning (ML) are vast in current interactive systems development. However, comparatively little is known about how functionality for the system behind the interface is designed and how design methodologies such as user-centered design have influence. This research focuses on how interdisciplinary teams that include UX practitioners design real-world enterprise ML systems outside of big technology companies. We conducted a survey with product managers, and interviews with interdisciplinary teams and individual UX practitioners. The findings show that nontechnical UX practitioners are highly capable in designing AI/ML systems. In addition to applying UX and interaction design expertise to make decisions regarding functionality, they employ skills that aid collaboration across interdisciplinary teams. However, our findings suggest existing HCI design techniques such as prototyping and simulating complexity of enterprise ML systems are insufficient. We propose adaptations to design practices and conclude that some existing research should be reconsidered.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get f2f4c8ef-6912-45f1-9e71-c2acf4200e39Cited by top-tier papers11
- Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI GuidebookNur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg et al.CHI 2023 · 103 citations
- Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI ChallengesQiaosi Wang, Michael Madaio, Shaun K. Kane, Shivani Kapania et al.CHI 2023 · 90 citations
- Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User ExperienceQ. Vera Liao, Hariharan Subramonyam, Jennifer Wang, Jennifer Wortman VaughanCHI 2023 · 81 citations
- Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care UnitNur Yildirim, Susanna Zlotnikov, Deniz Sayar, Jeremy M. Kahn et al.CHI 2024 · 32 citations
- Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning ExperiencesFred Hohman, Mary Beth Kery, Donghao Ren, Dominik MoritzCHI 2024 · 27 citations
Related papers
- Analyzing Collaborative Challenges and Needs of UX Practitioners when Designing with AI/MLMeena Devii Muralikumar, David W. McDonaldCSCW 2024 · 6 citations
- How Experienced Designers of Enterprise Applications Engage AI as a Design MaterialNur Yildirim, Alex Kass, Teresa Tung, Connor Upton et al.CHI 2022 · 69 citations
- Human Factors in Model Interpretability: Industry Practices, Challenges, and NeedsSungsoo Ray Hong, Jessica Hullman, Enrico BertiniCSCW 2020 · 219 citations
- Coordination Mechanisms in AI Development: Practitioner Experiences on Integrating UX ActivitiesAnders Bruun, Niels van Berkel, Dimitrios Raptis, Effie L.-C. LawCHI 2025 · 2 citations
- Marcelle: Composing Interactive Machine Learning Workflows and InterfacesJules Françoise, Baptiste Caramiaux, Téo SanchezUIST 2021 · 37 citations
