Trust in AI-assisted Decision Making: Perspectives from Those Behind the System and Those for Whom the Decision is Made
Oleksandra Vereschak, Fatemeh Alizadeh, Gilles Bailly, Baptiste Caramiaux
Abstract
Trust between humans and AI in the context of decisionmaking has acquired an important role in public policy, research and industry. In this context, Human-AI Trust has often been tackled from the lens of cognitive science and psychology, but lacks insights from the stakeholders involved. In this paper, we conducted semi-structured interviews with 7 AI practitioners and 7 decision subjects from various decision domains. We found that 1) interviewees identified the prerequisites for the existence of trust and distinguish trust from trustworthiness, reliance, and compliance; 2) trust in AI-integrated systems is strongly influenced by other human actors, more than the system's features; 3) the role of Human-AI trust factors is stakeholder-dependent. These results provide clues for the design of Human-AI interactions in which trust plays a major role, as well as outline new research directions in Human-AI Trust.
• Human-centered computing → HCI theory, concepts and models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3a9cba58-628d-41b7-af72-4ac29b437250Cited by top-tier papers8
- Generative AI in Documentary Photography: Exploring Opportunities and Challenges for Visual StorytellingLenny Martinez, Baptiste Caramiaux, Sarah Fdili AlaouiCHI 2025 · 10 citations
- Selective Trust: Understanding Human-AI Partnerships in Personal Health Decision-Making ProcessSterre R. van Arum, Hüseyin Ugur Genç, Dennis Reidsma, Armagan KarahanogluCHI 2025 · 10 citations
- Relational Dissonance in Human-AI Interactions: The Case of Knowledge WorkEmrecan Gulay, Eleonora Picco, Enrico Glerean, Corinna CoupetteCHI 2026 · 8 citations
- Are We Automating the Joy Out of Work? Designing AI to Augment Work, Not MeaningJaspreet Ranjit, Ke Zhou, Swabha Swayamdipta, Daniele QuerciaCHI 2026 · 2 citations
- Effect of AI Performance, Risk Perception, and Trust on Human Dependence in Deepfake Detection AI SystemYingfan Zhou, Ester Chen, Manasa Pisipati, Aiping Xiong et al.CSCW 2025 · 2 citations
Builds on26
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingZana Buçinca, Maja Barbara Malaya, Krzysztof Z. GajosCSCW 2021 · 962 citations
- Expanding Explainability: Towards Social Transparency in AI systemsUpol Ehsan, Q. Vera Liao, Michael J. Muller, Mark O. Riedl et al.CHI 2021 · 505 citations
- Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational PracticesBogdana Rakova, Jingying Yang, Henriette Cramer, Rumman ChowdhuryCSCW 2021 · 326 citations
- How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical MethodologiesOleksandra Vereschak, Gilles Bailly, Baptiste CaramiauxCSCW 2021 · 227 citations
- Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical LensMaia L. Jacobs, Jeffrey He, Melanie F. Pradier, Barbara D. Lam et al.CHI 2021 · 171 citations
Related papers
- "It's Not the AI's Fault Because It Relies Purely on Data": How Causal Attributions of AI Decisions Shape Trust in AI SystemsSaumya Pareek, Sarah Schömbs, Eduardo Velloso, Jorge GonçalvesCHI 2025 · 14 citations
- Do People Appropriately Rely on AI-Advice? An Analytical Review of HCI Research on Human-AI Decision-MakingMuhammad Raees, Vassilis-Javed Khan, Ioanna Lykourentzou, Konstantinos PapangelisCHI 2026 · 6 citations
- Modeling Human Trust and Reliance in AI-Assisted Decision Making: A Markovian ApproachZhuoyan Li, Zhuoran Lu, Ming YinAAAI 2023 · 28 citations
- Who Is Included in Human Perceptions of AI?: Trust and Perceived Fairness around Healthcare AI and Cultural MistrustMin Kyung Lee, Katherine RichCHI 2021 · 135 citations
- Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision MakingSuzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer et al.CHI 2022 · 68 citations
