"I Wouldn't Really Use It as a Practice Tool": Understanding Medical Students' Perspectives and Needs on LLM-Enhanced Clinical Skills Training
Yuru Huang, Chao Liu, Yunna Cai, Lina Xu, Yun Hou, Mingming Fan
Abstract
Large Language Models (LLMs) are expected to enhance medical education through personalized clinical skills training. However, their practical application from the student user experience perspective remains underexplored. This gap is critical because without understanding students’ needs, LLM-based tools risk poor adoption and suboptimal learning outcomes. This study explores medical students’ challenges and expectations when using LLM-based clinical skills training through a two-phase investigation involving 14 medical students. We integrated five Type 2 Diabetes cases into a probe platform and conducted probe-based studies followed by co-design workshops. We identified challenges across three categories: dialogue content (lack of realism, insufficient knowledge depth differentiation); dialogue presentation (information overload, single modality limitations); and dialogue interaction (inadequate guidance and feedback). Co-design workshops revealed expectations for enhanced patient modeling, personalized content delivery, structured presentation frameworks, and collaborative features. These findings provide design considerations for developing more effective, user-centered LLM-based medical education systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7da7a2ff-ca01-477a-9f52-192c4ec9b13aBuilds on8
- CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator NeedsMajeed Kazemitabaar, Runlong Ye, Xiaoning Wang, Austin Zachary Henley et al.CHI 2024 · 246 citations
- Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language ModelsMichael Xieyang Liu, Tongshuang Wu, Tianying Chen, Franklin Mingzhe Li et al.CHI 2024 · 44 citations
- Guiding Students in Using LLMs in Supported Learning Environments: Effects on Interaction Dynamics, Learner Performance, Confidence, and TrustHarsh Kumar, Ilya Musabirov, Mohi Reza, Jiakai Shi et al.CSCW 2024 · 43 citations
- Toward Enabling Natural Conversation with Older Adults via the Design of LLM-Powered Voice Agents that Support Interruptions and BackchannelsChao Liu, Mingyang Su, Yan Xiang, Yuru Huang et al.CHI 2025 · 27 citations
- Facilitating Virtual Reality Integration in Medical Education: A Case Study of Acceptability and Learning Impact in Childbirth Delivery TrainingChang Liu, Felicia Fang-Yi Tan, Shengdong Zhao, Abhiram Kanneganti et al.CHI 2024 · 20 citations
Related papers
- CaseMaster: Designing and Evaluating a Probe for Oral Case Presentation Training with LLM AssistanceYang Ouyang, Yuansong Xu, Chang Jiang, Yifan Jin et al.CHI 2026 · 1 citation
- Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic ProcrastinationAnanya Bhattacharjee, Yuchen Zeng, Sarah Yi Xu, Dana Kulzhabayeva et al.CHI 2024 · 39 citations
- Exploring Multimodal Generative AI for Education through Co-design Workshops with StudentsPrajish Prasad, Rishabh Balse, Dhwani BalchandaniCHI 2025 · 12 citations
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 892 citations
- Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded ReasoningJiayuan Zhu, Jiazhen Pan, Yuyuan Liu, Fenglin Liu et al.EMNLP 2025 · 1 citation
