Aspect-Oriented Summarization for Psychiatric Short-Term Readmission Prediction
Wonjin Yoon, Boyu Ren, Spencer Thomas, Chanhwi Kim, Guergana Savova, Mei-Hua Hall, Tim Miller
Abstract
Recent progress in large language models (LLMs) has enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. Yet, their zero-shot performance in complex tasks as opposed to straightforward information extraction tasks remains suboptimal. One feasible approach for tasks with lengthy, complex input is to first summarize the document and then apply supervised fine-tuning to the summary. However, the summarization process inevitably results in some loss of information. In this study we present a method for processing the summaries of long documents aimed to capture different important aspects of the original document. We hypothesize that LLM summaries generated with different aspect-oriented prompts contain different information signals, and we propose methods to measure these differences. We introduce approaches to effectively integrate signals from these different summaries for supervised training of transformer models. We validate our hypotheses on a high-impact task -30-day readmission prediction from a psychiatric discharge -using real-world data from four hospitals, and show that our proposed method increases the prediction performance for the complex task of predicting patient outcome. * 12/31/19**: Born * Unknown date: Diagnosed with Schizoaffective disorder, bipolar type * Unknown date: Diagnosed with borderline personality disorder * Unknown date: Diagnosed with polysubstance disorder, including alcohol and cannabis use * Unknown date: Multiple prior hospitalizations * Unknown date: History of self-injury by cutting, no known suicide attempts * 9/12/2030: Admitted to psychiatric hospital for evaluation and treatment of confusion/disorganization in the context of worsening depression and alcohol/cannabis use * 9/28/2030: Discharged from psychiatric hospital, diagnosed with Schizoaffective disorder, bipolar type, and prescribed lithium carbonate *** mg capsule nightly at bedtime.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on6
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
- ETC: Encoding Long and Structured Inputs in TransformersJoshua Ainslie, Santiago Ontañón, Chris Alberti, Vaclav Cvicek et al.EMNLP 2020 · 268 citations
- The Power of Scale for Parameter-Efficient Prompt TuningBrian Lester, Rami Al-Rfou, Noah ConstantEMNLP 2021 · 94 citations
Related papers
- Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and PredictionMaya Kruse, Shiyue Hu, Nicholas Derby, Yifu Wu et al.EMNLP Findings 2025 · 9 citations
- Evaluation of LLMs in Medical Text Summarization: The Role of Vocabulary Adaptation in High OOV SettingsGunjan Balde, Soumyadeep Roy, Mainack Mondal, Niloy GangulyACL Findings 2025 · 5 citations
- DelucionQA: Detecting Hallucinations in Domain-specific Question AnsweringMobashir Sadat, Zhengyu Zhou, Lukas Lange, Jun Araki et al.EMNLP Findings 2023 · 27 citations
- Can we generate portable representations for clinical time series data using LLMs?Zongliang Ji, Yifei Sun, Andre Carlos Kajdacsy-Balla Amaral, Anna Goldenberg et al.ICLR 2026 · 5 citations
- CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge NotesJames Mullenbach, Yada Pruksachatkun, Sean Adler, Jennifer Seale et al.ACL 2021
