Automatic and Structure-Aware Sparsification of Hybrid Neural ODEs with Application to Glucose Prediction
Bob Junyi Zou, Lu Tian
摘要
Hybrid neural ordinary differential equations (neural ODEs) integrate mechanistic models with neural ODEs, offering strong inductive bias and flexibility, and are particularly advantageous in data-scarce healthcare settings. However, excessive latent states and interactions from mechanistic models can lead to training inefficiency and over-fitting, limiting practical effectiveness of hybrid neural ODEs. In response, we propose a new hybrid pipeline for automatic state selection and structure optimization in mechanistic neural ODEs, combining domain-informed graph modifications with data-driven regularization to sparsify the model for improving predictive performance and stability while retaining mechanistic plausibility. Experiments on synthetic and real-world data show improved predictive performance and robustness with desired sparsity, establishing an effective solution for hybrid model reduction in healthcare applications. 1. S = s 1 , . . . , s n is the set of state variables with cardinality n, and s i (t) : [0, +∞) → R is a real-valued function of t representing the value of state s i at time t. 2. X = x 1 , . . . , x m is the set of exogenous input variables with cardinality m, and x j (t) : [0, +∞) → R is a function of t representing the value of input x j at time t.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Learning to Simulate Complex Physics with Graph NetworksAlvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying 等ICML 2020 · 被引用 1,439 次
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan 等ICLR 2020 · 被引用 1,155 次
- On the Parameterization and Initialization of Diagonal State Space ModelsAlbert Gu, Karan Goel, Ankit Gupta, Christopher RéNeurIPS 2022 · 被引用 690 次
- Graph Structure of Neural NetworksJiaxuan You, Jure Leskovec, Kaiming He, Saining XieICML 2020 · 被引用 168 次
- The Causal-Neural Connection: Expressiveness, Learnability, and InferenceKevin Xia, Kai-Zhan Lee, Yoshua Bengio, Elias BareinboimNeurIPS 2021 · 被引用 158 次
相关 Paper
- Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease ProgressionZhaozhi Qian, William R. Zame, Lucas M. Fleuren, Paul W. G. Elbers 等NeurIPS 2021 · 被引用 88 次
- Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic ResponseBob Junyi Zou, Matthew E. Levine, Dessi P. Zaharieva, Ramesh Johari 等ICML 2024 · 被引用 13 次
- Model-Based Control with Sparse Neural DynamicsZiang Liu, Genggeng Zhou, Jeff He, Tobia Marcucci 等NeurIPS 2023 · 被引用 28 次
- Sparse Flows: Pruning Continuous-depth ModelsLucas Liebenwein, Ramin M. Hasani, Alexander Amini, Daniela RusNeurIPS 2021 · 被引用 21 次
- Sparsity in Continuous-Depth Neural NetworksHananeh Aliee, Till Richter, Mikhail Solonin, Ignacio Ibarra 等NeurIPS 2022 · 被引用 21 次
