Text-Attributed Knowledge Graph Enrichment with Large Language Models for Medical Concept Representation
Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Chen Chen, Dongjie Wang, Zijun Yao
Abstract
In electronic health record (EHR) mining, learning high-quality representations of medical concepts (e.g., standardized diagnosis, medication, and procedure codes) is fundamental for downstream clinical prediction. However, ro bust concept representation learning is hindered by two key challenges: (i) clinically important cross-type dependencies (e.g., diagnosis medication and medication-procedure relations) are often missing or incomplete in existing ontology resources, limiting the ability to model complex EHR patterns; and (ii) rich clinical semantics are often missing from structured resources, and even when available as text, are difficult to integrate with KG structure for representation learning. To address these challenges, we present MedCo, an LLM empowered graph learning framework for medical concept representation. MedCo first builds a global knowledge graph (KG) over medical codes by combining statistically reliable associations mined from EHRs with type-constrained LLM prompting to infer semantic relations. It then utilizes LLMs to enrich the KG into a text-attributed graph by generating node descriptions and edge rationales, providing semantic signals for both concepts and their relationships. Finally, MedCo jointly trains a LoRA-tuned LLaMA text encoder with a heterogeneous GNN, fusing text semantics and graph structure into unified concept embeddings. Extensive experiments on MIMIC-III and MIMIC-IV show that MedCo consistently improves prediction performance and serves as an effective plug-in concept encoder for standard EHR pipelines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5809e01-335d-442f-af48-3edb3feec597Builds on4
- AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and RecalibrationLiantao Ma, Junyi Gao, Yasha Wang, Chaohe Zhang et al.AAAI 2020 · 156 citations
- GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge GraphsPengcheng Jiang, Cao Xiao, Adam Cross, Jimeng SunICLR 2024 · 77 citations
- Graph Transformers on EHRs: Better Representation Improves Downstream PerformanceRaphael Poulain, Rahmatollah BeheshtiICLR 2024 · 32 citations
- Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community RetrievalPengcheng Jiang, Cao Xiao, Minhao Jiang, Parminder Bhatia et al.ICLR 2025
Related papers
- Multimodal Medical Code TokenizerXiaorui Su, Shvat Messica, Yepeng Huang, Ruth Johnson et al.ICML 2025 · 2 citations
- Learning Conceptual-Contextual Embeddings for Medical TextXiao Zhang, Dejing Dou, Ji WuAAAI 2020 · 17 citations
- BoxLM: Unifying Structures and Semantics of Medical Concepts for Diagnosis Prediction in HealthcareYanchao Tan, Hang Lv, Yunfei Zhan, Guofang Ma et al.ICML 2025
- Reinforcement Learning for Tool-Calling Agents in Fast Healthcare Interoperability Resources (FHIR)Marius Knorr, Robert Müller, Jan Bremer, Nils SchweingruberICML 2026
- Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention GuidanceYue Fang, Yuxin Guo, Jiaran Gao, Hongxin Ding et al.AAAI 2026 · 4 citations
