Data-Centric Explanations: Explaining Training Data of Machine Learning Systems to Promote Transparency
Ariful Islam Anik, Andrea Bunt
Abstract
Training datasets fundamentally impact the performance of machine learning systems.
Any biases introduced during training (implicit or explicit) are often reflected in the system's behaviors leading to questions about fairness and loss of trust in the system. Yet, information on training data is rarely communicated to the stakeholders. In this thesis, I explore the concept of data-centric explanations for machine learning systems that describe the training data to end-users. I design data-centric explanations that focus on providing information on training data. Through a formative study, I investigate the potential utility of such an approach and the data-centric information that users find most compelling. In a second study, I investigate reactions to the explanations across four different system scenarios. The results show that data-centric explanations can impact how users judge the trustworthiness of a system and can assist users in assessing fairness. I discuss the implications of the findings for designing explanations to support users' perception of machine learning systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d177a9ad-5c66-4d24-ba19-abf36c0c667aCited by top-tier papers20
- On Selective, Mutable and Dialogic XAI: a Review of What Users Say about Different Types of Interactive ExplanationsAstrid Bertrand, Tiphaine Viard, Rafik Belloum, James R. Eagan et al.CHI 2023 · 53 citations
- Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science WorkChengbo Zheng, Dakuo Wang, April Yi Wang, Xiaojuan MaCHI 2022 · 53 citations
- Selective Explanations: Leveraging Human Input to Align Explainable AIVivian Lai, Yiming Zhang, Chacha Chen, Q. Vera Liao et al.CSCW 2023 · 49 citations
- Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision MakingSara Salimzadeh, Gaole He, Ujwal GadirajuCHI 2024 · 40 citations
- Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility AssessmentSaumya Pareek, Niels van Berkel, Eduardo Velloso, Jorge GonçalvesCSCW 2024 · 39 citations
Builds on2
- Questioning the AI: Informing Design Practices for Explainable AI User ExperiencesQ. Vera Liao, Daniel M. Gruen, Sarah MillerCHI 2020 · 758 citations
- Manipulating and Measuring Model InterpretabilityForough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan et al.CHI 2021 · 663 citations
Related papers
- EXMOS: Explanatory Model Steering through Multifaceted Explanations and Data ConfigurationsAditya Bhattacharya, Simone Stumpf, Lucija Gosak, Gregor Stiglic et al.CHI 2024 · 38 citations
- Debiased-CAM to mitigate image perturbations with faithful visual explanations of machine learningWencan Zhang, Mariella Dimiccoli, Brian Y. LimCHI 2022 · 12 citations
- My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine LearningAimen Gaba, Zhanna Kaufman, Jason Cheung, Marie Shvakel et al.IEEE VIS 2023 · 20 citations
- Understanding User Sensemaking in Machine Learning Fairness Assessment SystemsZiwei Gu, Jing Nathan Yan, Jeffrey M. RzeszotarskiWWW 2021 · 12 citations
- "Ignorance and Prejudice" in Software FairnessJie M. Zhang, Mark HarmanICSE 2021 · 69 citations
