Balancing Efficiency and Empathy: Healthcare Providers' Perspectives on AI-Supported Workflows for Serious Illness Conversations in the Emergency Department
Menglin Zhao, Zhuorui Yong, Ruijian Hannah Guan, Kai-Wei Chang, Adrian Haimovich, Kei Ouchi, Timothy W. Bickmore, Zhan Zhang, Bingsheng Yao, Dakuo Wang, Smit Desai
Abstract
Serious Illness Conversations (SICs)—discussions about values and care preferences for patients with life-threatening illness—rarely occur in Emergency Departments (EDs), despite evidence that early conversations improve care alignment and reduce unnecessary interventions. We interviewed 11 ED providers to identify challenges in SICs and opportunities for technology support, with a focus on AI. Our analysis revealed a four-stage SIC workflow (identification, preparation, conduction, documentation) and barriers at each stage, including fragmented patient information, limited time and space, lack of conversational guidance, and burdensome documentation. Providers expressed interest in AI systems for synthesizing information, supporting real-time conversations, and automating documentation, but emphasized concerns about preserving human connection and clinical autonomy. This tension highlights the need for technologies that enhance efficiency without undermining the interpersonal nature of SICs. We propose design guidelines for ambient and peripheral AI systems to support providers while preserving the essential humanity of these conversations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on28
- Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical LensMaia L. Jacobs, Jeffrey He, Melanie F. Pradier, Barbara D. Lam et al.CHI 2021 · 171 citations
- A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation AssessmentMin Hun Lee, Daniel P. Siewiorek, Asim Smailagic, Alexandre Bernardino et al.CHI 2021 · 131 citations
- Emotion AI at Work: Implications for Workplace Surveillance, Emotional Labor, and Emotional PrivacyKat Roemmich, Florian Schaub, Nazanin AndalibiCHI 2023 · 123 citations
- Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older AdultsZiqi Yang, Xuhai Xu, Bingsheng Yao, Ethan Rogers et al.UbiComp 2024 · 116 citations
- Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis DiagnosisShao Zhang, Jianing Yu, Xuhai Xu, Changchang Yin et al.CHI 2024 · 95 citations
Related papers
- With, not For: Co-Designing a Patient-Facing AI Companion Concept for the Emergency Department Waiting AreaJacobe Klein, Peter Sörries, Yasemin Mutlugil, Ceenu George et al.CHI 2026 · 4 citations
- AI Consent Futures: A Case Study on Voice Data Collection with CliniciansLauren Wilcox, Robin Brewer, Fernando DiazCSCW 2023 · 37 citations
- Rethinking Objectivity in Clinical AI: A Qualitative Study of Concussion EvaluatorsAli Zaidi, Jessica Jia-Wen Saw, Leigh Fu, Katherine Arneson et al.CSCW 2026
- Automating Clinical Documentation with Digital Scribes: Understanding the Impact on PhysiciansBrenna Li, Noah Crampton, Thomas Yeates, Yu Xia et al.CHI 2021 · 23 citations
- Navigating Value Elicitation: Insights from Palliative Care ProvidersDylan Thomas Doyle, Colleen Campbell, Adrian Petterson, Jed R. BrubakerCSCW 2025 · 2 citations
