Multimodal Disease Progression Modeling via Spatiotemporal Disentanglement and Multiscale Alignment
Chen Liu, Wenfang Yao, Kejing Yin, William K. Cheung, Jing Qin
摘要
Longitudinal multimodal data, including electronic health records (EHR) and sequential chest X-rays (CXRs), is critical for modeling disease progression, yet remains underutilized due to two key challenges: (1) redundancy in consecutive CXR sequences, where static anatomical regions dominate over clinically-meaningful dynamics, and (2) temporal misalignment between sparse, irregular imaging and continuous EHR data. We introduce , a novel framework that addresses these challenges through region-aware disentanglement and multi-timescale alignment. First, we disentangle static (anatomy) and dynamic (pathology progression) features in sequential CXRs, prioritizing disease-relevant changes. Second, we hierarchically align these static and dynamic CXR features with asynchronous EHR data via local (pairwise interval-level) and global (full-sequence) synchronization to model coherent progression pathways. Extensive experiments on the MIMIC dataset demonstrate that could effectively extract temporal clinical dynamics and achieve state-of-the-art performance on both disease progression identification and general ICU prediction tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Quantifying & Modeling Multimodal Interactions: An Information Decomposition FrameworkPaul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling 等NeurIPS 2023 · 被引用 120 次
- DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal InconsistencyWenfang Yao, Kejing Yin, William K. Cheung, Jia Liu 等AAAI 2024 · 被引用 80 次
- Improving Medical Predictions by Irregular Multimodal Electronic Health Records ModelingXinlu Zhang, Shiyang Li, Zhiyu Chen, Xifeng Yan 等ICML 2023 · 被引用 54 次
- Local Spatiotemporal Representation Learning for Longitudinally-consistent Neuroimage AnalysisMengwei Ren, Neel Dey, Martin Styner, Kelly N. Botteron 等NeurIPS 2022 · 被引用 26 次
- Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray GenerationWenfang Yao, Chen Liu, Kejing Yin, William Kwok-Wai Cheung 等NeurIPS 2024 · 被引用 11 次
相关 Paper
- LUMIN: A Longitudinal Multi-modal Knowledge Decomposition Network for Predicting Breast Cancer RecurrenceChunyao Lu, Tianyu Zhang, Xinglong Liang, Yuan Gao 等AAAI 2026
- The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate ItAaron Nicolson, Shengyao Zhuang, Jason Dowling, Bevan KoopmanACL 2025 · 被引用 6 次
- FlexCare: Leveraging Cross-Task Synergy for Flexible Multimodal Healthcare PredictionMuhao Xu, Zhenfeng Zhu, Youru Li, Shuai Zheng 等KDD 2024 · 被引用 5 次
- Temporal Inversion for Learning Interval Change in Chest X-RaysHanbin Ko, Kyeongmin Jeon, Doowoong Choi, Chang Min ParkCVPR 2026 · 被引用 3 次
- BiOTPrompt: Bidirectional Optimal Transport Guided Prompting for Disease Evolution-aware Radiology Report GenerationTengfei Liu, Yijian Fan, Boyue Wang, Yongli Hu 等CVPR 2026
