EMNLP Findings2020
Characterizing the Value of Information in Medical Notes
Chao-Chun Hsu, Shantanu Karnwal, Sendhil Mullainathan, Ziad Obermeyer, Chenhao Tan
Abstract
Machine learning models depend on the quality of input data. As electronic health records are widely adopted, the amount of data in health care is growing, along with complaints about the quality of medical notes. We use two prediction tasks, readmission prediction and in-hospital mortality prediction, to characterize the value of information in medical notes. We show that as a whole, medical notes only provide additional predictive power over structured information in readmission prediction. We further propose a probing framework to select parts of notes that enable more accurate predictions than using all notes, despite that the selected information leads to a distribution shift from the training data ("all notes"). Finally, we demonstrate that models trained on the selected valuable information achieve even better predictive performance, with only 6.8% of all the tokens for readmission prediction.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers2
- A Closer Look at AUROC and AUPRC under Class ImbalanceMatthew B. A. McDermott, Haoran Zhang, Lasse Hyldig Hansen, Giovanni Angelotti et al.NeurIPS 2024 · 191 citations
- Group-Sparse Matrix Factorization for Transfer Learning of Word EmbeddingsKan Xu, Xuanyi Zhao, Hamsa Bastani, Osbert BastaniICML 2021 · 10 citations
Related papers
- How to leverage the multimodal EHR data for better medical prediction?Bo Yang, Lijun WuEMNLP 2021 · 22 citations
- Predicting in-hospital mortality by combining clinical notes with time-series dataIman Deznabi, Mohit Iyyer, Madalina FiterauACL Findings 2021 · 40 citations
- P²²N: Patient Multi-view Multi-modal Feature Fusion Networks for Clinical Outcome PredictionYing Zhang, Baohang Zhou, Kehui Song, Xuhui Sui et al.EMNLP Findings 2022 · 9 citations
- Clinical Note Owns its Hierarchy: Multi-Level Hypergraph Neural Networks for Patient-Level Representation LearningNayeon Kim, Yinhua Piao, Sun KimACL 2023 · 3 citations
- Causal Representation Learning from Multimodal Clinical Records under Non-Random Modality MissingnessZihan Liang, Ziwen Pan, Ruoxuan XiongEMNLP 2025
