There's No "I" in TEAMMAIT: Impacts of Domain and Expertise on Trust in AI Teammates for Mental Health Work
Nathaniel Swinger, Cynthia M. Baseman, Myeonghan Ryu, Saeed Abdullah, Christopher W. Wiese, Andrew M. Sherrill, Rosa I. Arriaga
摘要
The mental health crisis in the United States spotlights the need for more scalable training for mental health workers. While present-day AI systems have sparked hope for addressing this problem, we must not be too quick to incorporate or solely focus on technological advancements. We must ask empirical questions about how to ethically collaborate with and integrate autonomous AI into the clinical workplace. For these Human-Autonomy Teams (HATs), poised to make the leap into the mental health domain, special consideration around the construct of trust is in order. A reflexive look toward the multidisciplinary nature of such HAT projects illuminates the need for a deeper dive into varied stakeholder considerations of ethics and trust. In this paper, we investigate the impact of domain---and the ranges of expertise within domains---on ethics- and trust-related considerations for HATs in mental health. We outline our engagement of 23 participants in two speculative activities: design fiction and factorial survey vignettes. Grounded by a video storyboard prototype, AI- and Psychotherapy-domain experts and novices alike imagined TEAMMAIT, a prospective AI system for psychotherapy training. From our inductive analysis emerged 10 themes surrounding ethics, trust, and collaboration. Three can be seen as substantial barriers to trust and collaboration, where participants imagined they would not work with an AI teammate that didn't meet these ethical standards. Another five of the themes can be seen as interrelated, context-dependent, and variable factors of trust that impact collaboration with an AI teammate. The final two themes represent more explicit engagement with the prospective role of an AI teammate in psychotherapy training practices. We conclude by evaluating our findings through the lens of Mayer et al.'s Integrative Model of Organizational Trust to discuss the risks of HATs and adapt models of ability-, benevolence-, and integrity-based trust. These updates motivate implications for the design and integration of HATs in mental health work.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper3
- Beyond a Conventional Chatbot: How AI Streamers Transcend Live Streaming Experiences from Viewers' PerspectivesYang Hu, Guo FreemanCHI 2026 · 被引用 2 次
- Designing with Medical Mistrust: Perspectives from Black Older Adults in Publicly Subsidized HousingCynthia M. Baseman, Reeda Shimaz Huda, Rosa I. ArriagaCHI 2026 · 被引用 1 次
- "Is This Really a Human Peer Supporter?": Misalignments Between Peer Supporters and Experts in LLM-Supported InteractionsKellie Yu Hui Sim, Roy Ka-Wei Lee, Kenny Tsu Wei ChooCSCW 2026
相关 Paper
- Trusting Autonomous Teammates in Human-AI Teams - A Literature ReviewWen Duan, Christopher Flathmann, Nathan J. McNeese, Matthew J. Scalia 等CHI 2025 · 被引用 23 次
- "If They Don't Even Trust Their AI Teammate, Why Should We?": Understanding Trust Contagion Across Multiple Human-AI Teams CSCW019Wen Duan, Shiwen Zhou, Matthew J. Scalia, Nan Weng 等CSCW 2026 · 被引用 1 次
- Human-Centered Team Training for Human-AI Teams: From Training with AI Tools to Training for AI TeammatesCaitlin Marie Lancaster, Wen Duan, Rohit Mallick, Nathan J. McNeeseCSCW 2025 · 被引用 13 次
- Understanding the Evolvement of Trust Over Time within Human-AI TeamsWen Duan, Shiwen Zhou, Matthew J. Scalia, Xiaoyun Yin 等CSCW 2024 · 被引用 42 次
- To be Healed or Hacked? - User-Centered Ethical Design for Embodied AI in Mental Health CareDavid Obremski, Paula Friedrich, Carolin WienrichIEEE VR 2026 · 被引用 2 次
