Expanding Explainability: Towards Social Transparency in AI systems
Upol Ehsan, Q. Vera Liao, Michael J. Muller, Mark O. Riedl, Justin D. Weisz
Abstract
As AI-powered systems increasingly mediate consequential decision-making, their explainability is critical for end-users to take informed and accountable actions. Explanations in human-human interactions are socially-situated. AI systems are often socio-organizationally embedded. However, Explainable AI (XAI) approaches have been predominantly algorithm-centered. We take a developmental step towards socially-situated XAI by introducing and exploring Social Transparency (ST), a sociotechnically informed perspective that incorporates the socio-organizational context into explaining AI-mediated decision-making. To explore ST conceptually, we conducted interviews with 29 AI users and practitioners grounded in a speculative design scenario. We suggested constitutive design elements of ST and developed a conceptual framework to unpack ST’s effect and implications at the technical, decision-making, and organizational level. The framework showcases how ST can potentially calibrate trust in AI, improve decision-making, facilitate organizational collective actions, and cultivate holistic explainability. Our work contributes to the discourse of Human-Centered XAI by expanding the design space of XAI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4a742c2e-c81a-4054-8951-14f519ed28b7Cited by top-tier papers69
- Explanations Can Reduce Overreliance on AI Systems During Decision-MakingHelena Vasconcelos, Matthew Jörke, Madeleine Grunde-McLaughlin, Tobias Gerstenberg et al.CSCW 2023 · 362 citations
- Design Principles for Generative AI ApplicationsJustin D. Weisz, Jessica He, Michael J. Muller, Gabriela Hoefer et al.CHI 2024 · 221 citations
- "Help Me Help the AI": Understanding How Explainability Can Support Human-AI InteractionSunnie S. Y. Kim, Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong et al.CHI 2023 · 178 citations
- Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewYang Shi, Tian Gao, Xiaohan Jiao, Nan CaoCSCW 2023 · 170 citations
- Understanding the impact of explanations on advice-taking: a user study for AI-based clinical Decision Support SystemsCecilia Panigutti, Andrea Beretta, Fosca Giannotti, Dino PedreschiCHI 2022 · 129 citations
Builds on7
- Questioning the AI: Informing Design Practices for Explainable AI User ExperiencesQ. Vera Liao, Daniel M. Gruen, Sarah MillerCHI 2020 · 758 citations
- Manipulating and Measuring Model InterpretabilityForough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan et al.CHI 2021 · 663 citations
- Interpreting Interpretability: Understanding Data Scientists' Use of Interpretability Tools for Machine LearningHarmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana et al.CHI 2020 · 541 citations
- Human Factors in Model Interpretability: Industry Practices, Challenges, and NeedsSungsoo Ray Hong, Jessica Hullman, Enrico BertiniCSCW 2020 · 219 citations
- No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive MLAlison Smith-Renner, Ron Fan, Melissa Birchfield, Tongshuang Wu et al.CHI 2020 · 117 citations
Related papers
- Seamful XAI: Operationalizing Seamful Design in Explainable AIUpol Ehsan, Q. Vera Liao, Samir Passi, Mark O. Riedl et al.CSCW 2024 · 41 citations
- Contextualizing User Perceptions about Biases for Human-Centered Explainable Artificial IntelligenceTina Chien-Wen Yuan, Nanyi Bi, Ya-Fang Lin, Yuen-Hsien TsengCHI 2023 · 30 citations
- Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIUpol Ehsan, Koustuv Saha, Munmun De Choudhury, Mark O. RiedlCSCW 2023 · 84 citations
- Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User ExperienceQ. Vera Liao, Hariharan Subramonyam, Jennifer Wang, Jennifer Wortman VaughanCHI 2023 · 81 citations
- XAIR: A Framework of Explainable AI in Augmented RealityXuhai Xu, Anna Yu, Tanya R. Jonker, Kashyap Todi et al.CHI 2023 · 73 citations
