Lune

ACL Findings2025

DiaLLMs: EHR-Enhanced Clinical Conversational System for Clinical Test Recommendation and Diagnosis Prediction

Weijieying Ren, Tianxiang Zhao, Lei Wang, Tianchun Wang, Vasant G. Honavar

Abstract

Recent advances in Large Language Models (LLMs) have led to remarkable progresses in medical consultation. However, existing medical LLMs overlook the essential role of Electronic Health Records (EHR) and focus primarily on diagnosis recommendation, limiting their clinical applicability. We propose DiaLLM, the first medical LLM that integrates heterogeneous EHR data into clinically grounded dialogues, enabling clinical test recommendation, result interpretation, and diagnosis prediction to better align with realworld medical practice. To construct clinically grounded dialogues from EHR, we design a Clinical Test Reference (CTR) strategy that maps each clinical code to its corresponding description and classifies test results as "normal" or "abnormal". Additionally, DiaLLM employs a reinforcement learning framework for evidence acquisition and automated diagnosis. To handle the large action space, we introduce a reject sampling strategy to reduce redundancy and improve exploration efficiency. Furthermore, a confirmation reward and a class-sensitive diagnosis reward are designed to guide accurate diagnosis prediction. Extensive experimental results demonstrate that DiaLLM outperforms baselines in clinical test recommendation and diagnosis prediction. Our code is available at Github 1 .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on9

  1. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
  2. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsYanis Labrak, Adrien Bazoge, Emmanuel Morin, Pierre-Antoine Gourraud et al.ACL Findings 2024 · 271 citations
  3. Learning to Utilize Shaping Rewards: A New Approach of Reward ShapingYujing Hu, Weixun Wang, Hangtian Jia, Yixiang Wang et al.NeurIPS 2020 · 256 citations
  4. Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-World Multi-Turn DialogueSonghua Yang, Hanjie Zhao, Senbin Zhu, Guangyu Zhou et al.AAAI 2024 · 227 citations
  5. GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge GraphsPengcheng Jiang, Cao Xiao, Adam Cross, Jimeng SunICLR 2024 · 77 citations

Related papers

  1. EviCare: Enhancing Diagnosis Prediction with Deep Model-Guided Evidence for In-Context ReasoningHengyu Zhang, Xuyun Zhang, Pengxiang Zhan, Linhao Luo et al.KDD 2026
  2. ReMedi: Reasoner for Medical Clinical PredictionYushi Cao, Yiming Chen, Hongchao Jiang, Hung-yi Lee et al.ACL Findings 2026
  3. Awaken the Giant: Activating LLMs via Deep Model Guidance for Boundary-aware Medication RecommendationHang Lv, Zixuan Guo, Yanchao Tan, Wanzi Shao et al.KDD 2026
  4. Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention GuidanceYue Fang, Yuxin Guo, Jiaran Gao, Hongxin Ding et al.AAAI 2026 · 4 citations
  5. DearLLM: Enhancing Personalized Healthcare via Large Language Models-Deduced Feature CorrelationsYongxin Xu, Xinke Jiang, Xu Chu, Rihong Qiu et al.AAAI 2025 · 7 citations
Dusk over the sea between two cliffs drawn in fine vertical lines