Lune

EMNLP Findings2025

A Comprehensive Survey on the Trustworthiness of Large Language Models in Healthcare

Manar Aljohani, Jun Hou, Sindhura Kommu, Xuan Wang

Abstract

The application of large language models (LLMs) in healthcare holds significant promise for enhancing clinical decision-making, medical research, and patient care. However, their integration into real-world clinical settings raises critical concerns around trustworthiness, particularly around dimensions of truthfulness, privacy, safety, robustness, fairness, and explainability. These dimensions are essential for ensuring that LLMs generate reliable, unbiased, and ethically sound outputs. While researchers have recently begun developing benchmarks and evaluation frameworks to assess LLM trustworthiness, the trustworthiness of LLMs in healthcare remains underexplored, lacking a systematic review that provides a comprehensive understanding and future insights. This survey addresses that gap by providing a comprehensive review of current methodologies and solutions aimed at mitigating risks across key trust dimensions. We analyze how each dimension affects the reliability and ethical deployment of healthcare LLMs, synthesize ongoing research efforts, and identify critical gaps in existing approaches. We also identify emerging challenges posed by evolving paradigms, such as multi-agent collaboration, multi-modal reasoning, and the development of small opensource medical models. Our goal is to guide future research toward more trustworthy, transparent, and clinically viable LLMs.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 5 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers5

  1. OralGPT-Omni: A Versatile Dental Multimodal Large Language ModelJing Hao, Yuci Liang, Lizhuo Lin, Yuxuan Fan et al.CVPR 2026 · 11 citations
  2. Truth as a Trajectory: What Internal Representations Reveal About Large Language Model ReasoningHamed Damirchi, Ignacio Meza De La Jara, Ehsan Abbasnejad, Afshar Shamsi et al.ACL 2026 · 8 citations
  3. Trustworthy Medical Question Answering: An Evaluation-Centric SurveyYinuo Wang, Baiyang Wang, Robert E. Mercer, Frank Rudzicz et al.EMNLP 2025 · 2 citations
  4. LLM4Cell: Taxonomy and Evaluation of LLM and Agentic Models for Single-Cell BiologySajib Acharjee Dip, Adrika Zafor, Bikash Kumar Paul, Uddip Acharjee Shuvo et al.ACL 2026
  5. When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical PressureBoyu Xiao, Xiuqi Tian, Xuwen Song, Haochun Wang et al.ACL 2026

Builds on25

  1. CRITIC: Large Language Models Can Self-Correct with Tool-Interactive CritiquingZhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen et al.ICLR 2024 · 699 citations
  2. Privacy Risks of General-Purpose Language ModelsXudong Pan, Mi Zhang, Shouling Ji, Min YangS&P 2020 · 291 citations
  3. Towards Mitigating LLM Hallucination via Self ReflectionZiwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee et al.EMNLP Findings 2023 · 274 citations
  4. DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language ModelsGe Zheng, Bin Yang, Jiajin Tang, Hong-Yu Zhou et al.NeurIPS 2023 · 252 citations
  5. Evidence-based Fact-Checking of Health-related ClaimsMourad Sarrouti, Asma Ben Abacha, Yassine Mrabet, Dina Demner-FushmanEMNLP Findings 2021 · 71 citations

Related papers

  1. CLINIC : Evaluating Multilingual Trustworthiness in Language Models for HealthcareAkash Ghosh, Srivarshinee Sridhar, Raghav Kaushik Ravi, Muhsin Muhsin et al.ICML 2026 · 6 citations
  2. CMedBench: A Comprehensive Benchmark for Efficient Medical Large Language ModelsShengbo Gao, Jinyang Guo, Lixian Su, Yifu Ding et al.AAAI 2026
  3. Beyond the Leaderboard: Rethinking Medical Benchmarks for Large Language ModelsWenxuan Wang, Zizhan Ma, Guo Yu, Yiu-Fai Cheung et al.ACL 2026 · 9 citations
  4. AudioTrust: Benchmarking The Multifaceted Trustworthiness of Audio Large Language ModelsKai Li, Can Shen, Yile Liu, Jirui Han et al.ICLR 2026 · 17 citations
  5. A Survey of LLM-based Agents in Medicine: How far are we from Baymax?Wenxuan Wang, Zizhan Ma, Zheng Wang, Chenghan Wu et al.ACL Findings 2025 · 51 citations
Dusk over the sea between two cliffs drawn in fine vertical lines