Differentiable Multi-Target Causal Bayesian Experimental Design
Panagiotis Tigas, Yashas Annadani, Desi R. Ivanova, Andrew Jesson, Yarin Gal, Adam Foster, Stefan Bauer
Abstract
We introduce a gradient-based approach for the problem of Bayesian optimal experimental design to learn causal models in a batch setting -- a critical component for causal discovery from finite data where interventions can be costly or risky. Existing methods rely on greedy approximations to construct a batch of experiments while using black-box methods to optimize over a single target-state pair to intervene with. In this work, we completely dispose of the black-box optimization techniques and greedy heuristics and instead propose a conceptually simple end-to-end gradient-based optimization procedure to acquire a set of optimal intervention target-state pairs. Such a procedure enables parameterization of the design space to efficiently optimize over a batch of multi-target-state interventions, a setting which has hitherto not been explored due to its complexity. We demonstrate that our proposed method outperforms baselines and existing acquisition strategies in both single-target and multi-target settings across a number of synthetic datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- BayesDAG: Gradient-Based Posterior Inference for Causal DiscoveryYashas Annadani, Nick Pawlowski, Joel Jennings, Stefan Bauer et al.NeurIPS 2023 · 54 citations
- Amortized Active Causal Induction with Deep Reinforcement LearningYashas Annadani, Panagiotis Tigas, Stefan Bauer, Adam FosterNeurIPS 2024 · 13 citations
- ProDAG: Projected Variational Inference for Directed Acyclic GraphsRyan Thompson, Edwin V. Bonilla, Robert KohnNeurIPS 2025 · 6 citations
- Bayesian Active Causal Discovery with Multi-Fidelity ExperimentsZeyu Zhang, Chaozhuo Li, Xu Chen, Xing XieNeurIPS 2023 · 5 citations
- Experimental Design for Multi-Channel Imaging via Task-Driven Feature SelectionStefano B. Blumberg, Paddy J. Slator, Daniel C. AlexanderICLR 2024 · 1 citation
Builds on9
- Deep Adaptive Design: Amortizing Sequential Bayesian Experimental DesignAdam Foster, Desi R. Ivanova, Ilyas Malik, Tom RainforthICML 2021 · 119 citations
- Bayesian Experimental Design for Implicit Models by Mutual Information Neural EstimationSteven Kleinegesse, Michael U. GutmannICML 2020 · 84 citations
- Implicit Deep Adaptive Design: Policy-Based Experimental Design without LikelihoodsDesi R. Ivanova, Adam Foster, Steven Kleinegesse, Michael U. Gutmann et al.NeurIPS 2021 · 81 citations
- Interventions, Where and How? Experimental Design for Causal Models at ScalePanagiotis Tigas, Yashas Annadani, Andrew Jesson, Bernhard Schölkopf et al.NeurIPS 2022 · 68 citations
- Optimizing Sequential Experimental Design with Deep Reinforcement LearningTom Blau, Edwin V. Bonilla, Iadine Chades, Amir DezfouliICML 2022 · 62 citations
Related papers
- Trust Your 𝛁: Gradient-based Intervention Targeting for Causal DiscoveryMateusz Olko, Michal Zajac, Aleksandra Nowak, Nino Scherrer et al.NeurIPS 2023
- Policy-Based Bayesian Active Causal Discovery with Deep Reinforcement LearningHeyang Gao, Zexu Sun, Hao Yang, Xu ChenKDD 2024 · 1 citation
- Near-Optimal Multi-Perturbation Experimental Design for Causal Structure LearningScott Sussex, Caroline Uhler, Andreas KrauseNeurIPS 2021 · 24 citations
- Constrained Causal Bayesian OptimizationVirginia Aglietti, Alan Malek, Ira Ktena, Silvia ChiappaICML 2023 · 9 citations
- Model-based Causal Bayesian OptimizationScott Sussex, Anastasia Makarova, Andreas KrauseICLR 2023 · 1 citation
