Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression
Zhaozhi Qian, William R. Zame, Lucas M. Fleuren, Paul W. G. Elbers, Mihaela van der Schaar
Abstract
Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental problem in many areas. Pure Machine Learning (ML) approaches often fail in the small sample regime and cannot provide actionable insights beyond predictions. A promising modification has been to incorporate expert domain knowledge into ML models. The application we consider is predicting the progression of disease under medications, where a plethora of domain knowledge is available from pharmacology. Pharmacological models describe the dynamics of carefully-chosen medically meaningful variables in terms of systems of Ordinary Differential Equations (ODEs). However, these models only describe a limited collection of variables, and these variables are often not observable in clinical environments. To close this gap, we propose the latent hybridisation model (LHM) that integrates a system of expert-designed ODEs with machine-learned Neural ODEs to fully describe the dynamics of the system and to link the expert and latent variables to observable quantities. We evaluated LHM on synthetic data as well as real-world intensive care data of COVID-19 patients. LHM consistently outperforms previous works, especially when few training samples are available such as at the beginning of the pandemic.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers17
- Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative ModelingNaoya Takeishi, Alexandros KalousisNeurIPS 2021 · 88 citations
- Generalization bounds for neural ordinary differential equations and deep residual networksPierre MarionNeurIPS 2023 · 37 citations
- Automatically Learning Hybrid Digital Twins of Dynamical SystemsSamuel Holt, Tennison Liu, Mihaela van der SchaarNeurIPS 2024 · 26 citations
- MetaCare++: Meta-Learning with Hierarchical Subtyping for Cold-Start Diagnosis Prediction in Healthcare DataYanchao Tan, Carl Yang, Xiangyu Wei, Chaochao Chen et al.SIGIR 2022 · 24 citations
- Learning interacting dynamical systems with latent Gaussian process ODEsÇagatay Yildiz, Melih Kandemir, Barbara RakitschNeurIPS 2022 · 14 citations
Builds on7
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with ControlYaofeng Desmond Zhong, Biswadip Dey, Amit ChakrabortyICLR 2020 · 319 citations
- Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual MethodsFerdinando Fioretto, Terrence W. K. Mak, Pascal Van HentenryckAAAI 2020 · 250 citations
- Neural ODE ProcessesAlexander Norcliffe, Cristian Bodnar, Ben Day, Jacob Moss et al.ICLR 2021 · 78 citations
- Neural Clustering ProcessesAri Pakman, Yueqi Wang, Catalin Mitelut, Jin Hyung Lee et al.ICML 2020 · 28 citations
Related papers
- Automatic and Structure-Aware Sparsification of Hybrid Neural ODEs with Application to Glucose PredictionBob Junyi Zou, Lu TianICLR 2026
- Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic ResponseBob Junyi Zou, Matthew E. Levine, Dessi P. Zaharieva, Ramesh Johari et al.ICML 2024 · 13 citations
- GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge GraphsPengcheng Jiang, Cao Xiao, Adam Cross, Jimeng SunICLR 2024 · 77 citations
- A Probabilistic State Space Model for Joint Inference from Differential Equations and DataJonathan Schmidt, Nicholas Krämer, Philipp HennigNeurIPS 2021 · 30 citations
- Interpretable Sequence Learning for Covid-19 ForecastingSercan Ömer Arik, Chun-Liang Li, Jinsung Yoon, Rajarishi Sinha et al.NeurIPS 2020 · 105 citations
