Intervention Generalization: A View from Factor Graph Models
Gecia Bravo Hermsdorff, David S. Watson, Jialin Yu, Jakob Zeitler, Ricardo Silva
Abstract
One of the goals of causal inference is to generalize from past experiments and observational data to novel conditions. While it is in principle possible to eventually learn a mapping from a novel experimental condition to an outcome of interest, provided a sufficient variety of experiments is available in the training data, coping with a large combinatorial space of possible interventions is hard. Under a typical sparse experimental design, this mapping is ill-posed without relying on heavy regularization or prior distributions. Such assumptions may or may not be reliable, and can be hard to defend or test. In this paper, we take a close look at how to warrant a leap from past experiments to novel conditions based on minimal assumptions about the factorization of the distribution of the manipulated system, communicated in the well-understood language of factor graph models. A postulated interventional factor model (IFM) may not always be informative, but it conveniently abstracts away a need for explicitly modeling unmeasured confounding and feedback mechanisms, leading to directly testable claims. Given an IFM and datasets from a collection of experimental regimes, we derive conditions for identifiability of the expected outcomes of new regimes never observed in these training data. We implement our framework using several efficient algorithms, and apply them on a range of semi-synthetic experiments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Identifying Representations for Intervention ExtrapolationSorawit Saengkyongam, Elan Rosenfeld, Pradeep Kumar Ravikumar, Niklas Pfister et al.ICLR 2024 · 20 citations
- Synthetic Combinations: A Causal Inference Framework for Combinatorial InterventionsAbhineet Agarwal, Anish Agarwal, Suhas VijaykumarNeurIPS 2023 · 14 citations
- Structured Learning of Compositional Sequential InterventionsJialin Yu, Andreas Koukorinis, Nicolò Colombo, Yuchen Zhu et al.NeurIPS 2024 · 2 citations
- Factor Graph-based Interpretable Neural NetworksYicong Li, Kuanjiu Zhou, Shuo Yu, Qiang Zhang et al.ICLR 2025
- Learning Joint Interventional Effects from Single-Variable Interventions in Additive ModelsArmin Kekic, Sergio Hernan Garrido Mejia, Bernhard SchölkopfICML 2025
Builds on11
- Invariant Causal Prediction for Block MDPsAmy Zhang, Clare Lyle, Shagun Sodhani, Angelos Filos et al.ICML 2020 · 153 citations
- A Calculus for Stochastic Interventions: Causal Effect Identification and Surrogate ExperimentsJuan D. Correa, Elias BareinboimAAAI 2020 · 90 citations
- Interventions, Where and How? Experimental Design for Causal Models at ScalePanagiotis Tigas, Yashas Annadani, Andrew Jesson, Bernhard Schölkopf et al.NeurIPS 2022 · 68 citations
- General Transportability of Soft Interventions: Completeness ResultsJuan D. Correa, Elias BareinboimNeurIPS 2020 · 40 citations
- Adaptively Exploiting d-Separators with Causal BanditsBlair L. Bilodeau, Linbo Wang, Daniel M. RoyNeurIPS 2022 · 25 citations
Related papers
- Nonparametric Identifiability of Causal Representations from Unknown InterventionsJulius von Kügelgen, Michel Besserve, Wendong Liang, Luigi Gresele et al.NeurIPS 2023 · 127 citations
- A Proxy Variable View of Shared ConfoundingYixin Wang, David M. BleiICML 2021 · 14 citations
- Learning Nonparametric Latent Causal Graphs with Unknown InterventionsYibo Jiang, Bryon AragamNeurIPS 2023 · 39 citations
- Causal Effect Identifiability under Partial-ObservabilitySanghack Lee, Elias BareinboimICML 2020 · 26 citations
- Interventional Causal Representation LearningKartik Ahuja, Divyat Mahajan, Yixin Wang, Yoshua BengioICML 2023 · 143 citations
