Structured Learning of Compositional Sequential Interventions
Jialin Yu, Andreas Koukorinis, Nicolò Colombo, Yuchen Zhu, Ricardo Silva
Abstract
We consider sequential treatment regimes where each unit is exposed to combinations of interventions over time. When interventions are described by qualitative labels, such as"close schools for a month due to a pandemic"or"promote this podcast to this user during this week", it is unclear which appropriate structural assumptions allow us to generalize behavioral predictions to previously unseen combinations of interventions. Standard black-box approaches mapping sequences of categorical variables to outputs are applicable, but they rely on poorly understood assumptions on how reliable generalization can be obtained, and may underperform under sparse sequences, temporal variability, and large action spaces. To approach that, we pose an explicit model for composition, that is, how the effect of sequential interventions can be isolated into modules, clarifying which data conditions allow for the identification of their combined effect at different units and time steps. We show the identification properties of our compositional model, inspired by advances in causal matrix factorization methods. Our focus is on predictive models for novel compositions of interventions instead of matrix completion tasks and causal effect estimation. We compare our approach to flexible but generic black-box models to illustrate how structure aids prediction in sparse data conditions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Learning Coupled Continuous-Time Latent Dynamics from Irregular EventsJiankai Zuo, Yang Zhang, Yu Zhang, Jiarui Liang et al.ICML 2026
- Causal Fine-Tuning under Latent Confounded ShiftJialin Yu, Yuxiang Zhou, Haoxuan Li, Junchi Yu et al.ICML 2026
Builds on11
- Adaptive Conformal Inference Under Distribution ShiftIsaac Gibbs, Emmanuel J. CandèsNeurIPS 2021 · 665 citations
- Conformal PID Control for Time Series PredictionAnastasios Angelopoulos, Emmanuel J. Candès, Ryan J. TibshiraniNeurIPS 2023 · 164 citations
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava et al.NeurIPS 2023 · 120 citations
- A Calculus for Stochastic Interventions: Causal Effect Identification and Surrogate ExperimentsJuan D. Correa, Elias BareinboimAAAI 2020 · 90 citations
- Designing Optimal Dynamic Treatment Regimes: A Causal Reinforcement Learning ApproachJunzhe ZhangICML 2020 · 78 citations
Related papers
- Synthetic Combinations: A Causal Inference Framework for Combinatorial InterventionsAbhineet Agarwal, Anish Agarwal, Suhas VijaykumarNeurIPS 2023 · 14 citations
- Intervention Generalization: A View from Factor Graph ModelsGecia Bravo Hermsdorff, David S. Watson, Jialin Yu, Jakob Zeitler et al.NeurIPS 2023 · 7 citations
- Disentangling Causal Effects from Sets of Interventions in the Presence of Unobserved ConfoundersOlivier Jeunen, Ciarán M. Gilligan-Lee, Rishabh Mehrotra, Mounia LalmasNeurIPS 2022 · 15 citations
- Learning by Analogy: A Causal Framework for Compositional GeneralizationLingjing Kong, Shaoan Xie, Yang Jiao, Yetian Chen et al.CVPR 2026
- Learning Joint Interventional Effects from Single-Variable Interventions in Additive ModelsArmin Kekic, Sergio Hernan Garrido Mejia, Bernhard SchölkopfICML 2025
