Learning the Dynamics of Sparsely Observed Interacting Systems
Linus Bleistein, Adeline Fermanian, Anne-Sophie Jannot, Agathe Guilloux
Abstract
We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of the target time series. Once learned, we can use these dynamics to predict values of the target from the previous values of the feature time series. We frame this task as learning the solution map of a controlled differential equation (CDE). By leveraging the rich theory of signatures, we are able to cast this non-linear problem as a high-dimensional linear regression. We provide an oracle bound on the prediction error which exhibits explicit dependencies on the individual-specific sampling schemes. Our theoretical results are illustrated by simulations which show that our method outperforms existing algorithms for recovering the full time series while being computationally cheap. We conclude by demonstrating its potential on real-world epidemiological data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 436cff2e-bedc-45ee-8060-4790e711aae3Cited by top-tier papers2
- Dynamic Survival Analysis with Controlled Latent StatesLinus Bleistein, Van-Tuan Nguyen, Adeline Fermanian, Agathe GuillouxICML 2024 · 6 citations
- On the Generalization and Approximation Capacities of Neural Controlled Differential EquationsLinus Bleistein, Agathe GuillouxICLR 2024 · 4 citations
Builds on5
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- Neural Rough Differential Equations for Long Time SeriesJames Morrill, Cristopher Salvi, Patrick Kidger, James FosterICML 2021 · 176 citations
- Signatory: differentiable computations of the signature and logsignature transforms, on both CPU and GPUPatrick Kidger, Terry J. LyonsICLR 2021 · 97 citations
- Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and FilteringCalypso Herrera, Florian Krach, Josef TeichmannICLR 2021 · 43 citations
- Framing RNN as a kernel method: A neural ODE approachAdeline Fermanian, Pierre Marion, Jean-Philippe Vert, Gérard BiauNeurIPS 2021 · 34 citations
Related papers
- Controlled Differential Equations on Long Sequences via Non-standard WaveletsSourav Pal, Zhanpeng Zeng, Sathya N. Ravi, Vikas SinghICML 2023 · 3 citations
- Neural graphical modelling in continuous-time: consistency guarantees and algorithmsAlexis Bellot, Kim Branson, Mihaela van der SchaarICLR 2022 · 57 citations
- Sparsity in Continuous-Depth Neural NetworksHananeh Aliee, Till Richter, Mikhail Solonin, Ignacio Ibarra et al.NeurIPS 2022 · 21 citations
- Identifiability Challenges in Sparse Linear Ordinary Differential EquationsCecilia Casolo, Sören Becker, Niki KilbertusICLR 2026 · 7 citations
- Latent Convergent Cross MappingEdward De Brouwer, Adam Arany, Jaak Simm, Yves MoreauICLR 2021 · 5 citations
