Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Models
Matej Zecevic, Devendra Singh Dhami, Athresh Karanam, Sriraam Natarajan, Kristian Kersting
Abstract
While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sumproduct networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, effectively subsuming Pearl's do-operator, the gate function predicts the parameters of the SPN. The resulting interventional SPNs are motivated and illustrated by a structural causal model themed around personal health. Our empirical evaluation against competing methods from both generative and causal modelling demonstrates that interventional SPNs indeed are both expressive and causally adequate. Recently, there has been an effort to take advantage of this tractability to reason for causality. Zhao et al. [2015] showed how to compile back and forth between sum-product networks (SPNs) and Bayesian networks (BNs). Although this opened up a whole range of possibilities for tractable 35th Conference on Neural Information Processing Systems (NeurIPS 2021), virtual.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- HyperSPNs: Compact and Expressive Probabilistic CircuitsAndy Shih, Dorsa Sadigh, Stefano ErmonNeurIPS 2021 · 17 citations
- A Compositional Atlas for Algebraic CircuitsBenjie Wang, Denis Deratani Mauá, Guy Van den Broeck, YooJung ChoiNeurIPS 2024 · 13 citations
- Characteristic CircuitsZhongjie Yu, Martin Trapp, Kristian KerstingNeurIPS 2023 · 8 citations
- Conditional Generative Models are Sufficient to Sample from Any Causal Effect EstimandMd. Musfiqur Rahman, Matt Jordan, Murat KocaogluNeurIPS 2024 · 7 citations
Builds on3
- Differentiable Causal Discovery from Interventional DataPhilippe Brouillard, Sébastien Lachapelle, Alexandre Lacoste, Simon Lacoste-Julien et al.NeurIPS 2020 · 295 citations
- The Causal-Neural Connection: Expressiveness, Learnability, and InferenceKevin Xia, Kai-Zhan Lee, Yoshua Bengio, Elias BareinboimNeurIPS 2021 · 158 citations
- Time Series Deconfounder: Estimating Treatment Effects over Time in the Presence of Hidden ConfoundersIoana Bica, Ahmed M. Alaa, Mihaela van der SchaarICML 2020 · 133 citations
Related papers
- Top-Down Bayesian Posterior Sampling for Sum-Product NetworksSoma Yokoi, Issei SatoKDD 2024
- Intervention and Conditioning in Causal Bayesian NetworksSainyam Galhotra, Joseph Y. HalpernNeurIPS 2024 · 6 citations
- Probabilistic Neural CircuitsPedro Zuidberg Dos MartiresAAAI 2024 · 11 citations
- Do-PFN: In-Context Learning for Causal Effect EstimationJake Robertson, Arik Reuter, Siyuan Guo, Noah Hollmann et al.NeurIPS 2025 · 58 citations
- Sum-Product-Set Networks: Deep Tractable Models for Tree-Structured GraphsMilan Papez, Martin Rektoris, Václav Smídl, Tomás PevnýICLR 2024 · 5 citations
