Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making
Shreya Chappidi, Jatinder Singh, Andra Valentina Krauze
摘要
LLMs are increasingly supporting decision-making across high-stakes domains, requiring critical reflection on the socio-technical factors that shape how humans and LLMs are assigned roles and interact during human-in-the-loop decision-making. This paper introduces the concept of human-LLM archetypes – defined as recurring socio-technical interaction patterns that structure the roles of humans and LLMs in collaborative decision-making. We describe 17 human-LLM archetypes derived from a scoping literature review and thematic analysis of 113 LLM-supported decision-making papers. Then, we evaluate these diverse archetypes across real-world clinical diagnostic cases to examine the potential effects of adopting distinct human-LLM archetypes on LLM outputs and decision outcomes. Finally, we present relevant tradeoffs and design choices across human-LLM archetypes, including decision control, social hierarchies, cognitive forcing strategies, and information requirements. Through our analysis, we show that selection of human-LLM interaction archetype can influence LLM outputs and decisions, bringing important risks and considerations for the designers of human-AI decision-making systems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper60
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 被引用 22,562 次
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo 等NeurIPS 2022 · 被引用 8,168 次
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingZana Buçinca, Maja Barbara Malaya, Krzysztof Z. GajosCSCW 2021 · 被引用 962 次
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 被引用 892 次
相关 Paper
- Do People Appropriately Rely on AI-Advice? An Analytical Review of HCI Research on Human-AI Decision-MakingMuhammad Raees, Vassilis-Javed Khan, Ioanna Lykourentzou, Konstantinos PapangelisCHI 2026 · 被引用 6 次
- More than Decision Support: Exploring Patients' Longitudinal Usage of Large Language Models in Real-World Healthcare-Seeking JourneysYancheng Cao, Yishu Ji, Chris Yue Fu, Sahiti Dharmavaram 等CHI 2026 · 被引用 2 次
- Formalising Human-in-the-Loop: Computational Reductions, Failure Modes, and Legal-Moral ResponsibilityMaurice Chiodo, Dennis Müller, Paul Siewert, Jean-Luc Wetherall 等ICLR 2026 · 被引用 10 次
- AI Shall Have No Dominion: on How to Measure Technology Dominance in AI-supported Human decision-makingFederico Cabitza, Andrea Campagner, Riccardo Angius, Chiara Natali 等CHI 2023 · 被引用 47 次
- Multi-Round Human–AI Collaboration with User-Specified RequirementsSima Noorani, Shayan Kiyani, Hamed Hassani, George PappasICML 2026 · 被引用 2 次
