Lune

EMNLP Findings2020

Characterizing the Value of Information in Medical Notes

Chao-Chun Hsu, Shantanu Karnwal, Sendhil Mullainathan, Ziad Obermeyer, Chenhao Tan

Abstract

Machine learning models depend on the quality of input data. As electronic health records are widely adopted, the amount of data in health care is growing, along with complaints about the quality of medical notes. We use two prediction tasks, readmission prediction and in-hospital mortality prediction, to characterize the value of information in medical notes. We show that as a whole, medical notes only provide additional predictive power over structured information in readmission prediction. We further propose a probing framework to select parts of notes that enable more accurate predictions than using all notes, despite that the selected information leads to a distribution shift from the training data ("all notes"). Finally, we demonstrate that models trained on the selected valuable information achieve even better predictive performance, with only 6.8% of all the tokens for readmission prediction.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. A Closer Look at AUROC and AUPRC under Class ImbalanceMatthew B. A. McDermott, Haoran Zhang, Lasse Hyldig Hansen, Giovanni Angelotti et al.NeurIPS 2024 · 191 citations
  2. Group-Sparse Matrix Factorization for Transfer Learning of Word EmbeddingsKan Xu, Xuanyi Zhao, Hamsa Bastani, Osbert BastaniICML 2021 · 10 citations

Related papers

  1. How to leverage the multimodal EHR data for better medical prediction?Bo Yang, Lijun WuEMNLP 2021 · 22 citations
  2. Predicting in-hospital mortality by combining clinical notes with time-series dataIman Deznabi, Mohit Iyyer, Madalina FiterauACL Findings 2021 · 40 citations
  3. P²²N: Patient Multi-view Multi-modal Feature Fusion Networks for Clinical Outcome PredictionYing Zhang, Baohang Zhou, Kehui Song, Xuhui Sui et al.EMNLP Findings 2022 · 9 citations
  4. Clinical Note Owns its Hierarchy: Multi-Level Hypergraph Neural Networks for Patient-Level Representation LearningNayeon Kim, Yinhua Piao, Sun KimACL 2023 · 3 citations
  5. Causal Representation Learning from Multimodal Clinical Records under Non-Random Modality MissingnessZihan Liang, Ziwen Pan, Ruoxuan XiongEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines