ODE Discovery for Longitudinal Heterogeneous Treatment Effects Inference
Krzysztof Kacprzyk, Samuel Holt, Jeroen Berrevoets, Zhaozhi Qian, Mihaela van der Schaar
Abstract
Inferring unbiased treatment effects has received widespread attention in the machine learning community. In recent years, our community has proposed numerous solutions in standard settings, high-dimensional treatment settings, and even longitudinal settings. While very diverse, the solution has mostly relied on neural networks for inference and simultaneous correction of assignment bias. New approaches typically build on top of previous approaches by proposing new (or refined) architectures and learning algorithms. However, the end result -- a neural-network-based inference machine -- remains unchallenged. In this paper, we introduce a different type of solution in the longitudinal setting: a closed-form ordinary differential equation (ODE). While we still rely on continuous optimization to learn an ODE, the resulting inference machine is no longer a neural network. Doing so yields several advantages such as interpretability, irregular sampling, and a different set of identification assumptions. Above all, we consider the introduction of a completely new type of solution to be our most important contribution as it may spark entirely new innovations in treatment effects in general. We facilitate this by formulating our contribution as a framework that can transform any ODE discovery method into a treatment effects method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 871e2b40-6a2e-4d22-9538-6d9cba3223c3Cited by top-tier papers8
- Discovering Preference Optimization Algorithms with and for Large Language ModelsChris Lu, Samuel Holt, Claudio Fanconi, Alex J. Chan et al.NeurIPS 2024 · 41 citations
- Automatically Learning Hybrid Digital Twins of Dynamical SystemsSamuel Holt, Tennison Liu, Mihaela van der SchaarNeurIPS 2024 · 26 citations
- Data-Driven Discovery of Dynamical Systems in Pharmacology using Large Language ModelsSamuel Holt, Zhaozhi Qian, Tennison Liu, James Weatherall et al.NeurIPS 2024 · 16 citations
- Skip the Equations: Learning Behavior of Personalized Dynamical Systems Directly From DataKrzysztof Kacprzyk, Julianna Piskorz, Mihaela van der SchaarICML 2025
- G-Sim: Generative Simulations with Large Language Models and Gradient-Free CalibrationSamuel Holt, Max Ruiz Luyten, Antonin Berthon, Mihaela van der SchaarICML 2025
Builds on13
- Discovering Symbolic Models from Deep Learning with Inductive BiasesMiles D. Cranmer, Alvaro Sanchez-Gonzalez, Peter W. Battaglia, Rui Xu et al.NeurIPS 2020 · 736 citations
- Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientsBrenden K. Petersen, Mikel Landajuela, T. Nathan Mundhenk, Cláudio Prata Santiago et al.ICLR 2021 · 444 citations
- Estimating counterfactual treatment outcomes over time through adversarially balanced representationsIoana Bica, Ahmed M. Alaa, James Jordon, Mihaela van der SchaarICLR 2020 · 224 citations
- Causal Transformer for Estimating Counterfactual OutcomesValentyn Melnychuk, Dennis Frauen, Stefan FeuerriegelICML 2022 · 146 citations
- Time Series Deconfounder: Estimating Treatment Effects over Time in the Presence of Hidden ConfoundersIoana Bica, Ahmed M. Alaa, Mihaela van der SchaarICML 2020 · 133 citations
Related papers
- Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential EquationsNabeel Seedat, Fergus Imrie, Alexis Bellot, Zhaozhi Qian et al.ICML 2022 · 68 citations
- Estimating Treatment Effects from Irregular Time Series Observations with Hidden ConfoundersDefu Cao, James Enouen, Yujing Wang, Xiangchen Song et al.AAAI 2023 · 28 citations
- D-CODE: Discovering Closed-form ODEs from Observed TrajectoriesZhaozhi Qian, Krzysztof Kacprzyk, Mihaela van der SchaarICLR 2022 · 32 citations
- Coordinated Double Machine LearningNitai Fingerhut, Matteo Sesia, Yaniv RomanoICML 2022 · 5 citations
- Bayesian Neural Controlled Differential Equations for Treatment Effect EstimationKonstantin Hess, Valentyn Melnychuk, Dennis Frauen, Stefan FeuerriegelICLR 2024 · 27 citations
