Learning Causal Effects via Weighted Empirical Risk Minimization
Yonghan Jung, Jin Tian, Elias Bareinboim
Abstract
Learning causal effects from data is a fundamental problem across the sciences. Determining the identifiability of a target effect from a combination of the observational distribution and the causal graph underlying a phenomenon is well-understood in theory. However, in practice, it remains a challenge to apply the identification theory to estimate the identified causal functionals from finite samples. Although a plethora of effective estimators have been developed under the setting known as the back-door (also called conditional ignorability), there exists still no systematic way of estimating arbitrary causal functionals that are both computationally and statistically attractive. This paper aims to bridge this gap, from causal identification to causal estimation. We note that estimating functionals from limited samples based on the empirical risk minimization (ERM) principle has been pervasive in the machine learning literature, and these methods have been extended to causal inference under the back-door setting. In this paper, we develop a learning framework that marries two families of methods, benefiting from the generality of the causal identification theory and the effectiveness of the estimators produced based on the principle of ERM. Specifically, we develop a sound and complete algorithm that generates causal functionals in the form of weighted distributions that are amenable to the ERM optimization. We then provide a practical procedure for learning causal effects from finite samples and a causal graph. Finally, experimental results support the effectiveness of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers20
- The Causal-Neural Connection: Expressiveness, Learnability, and InferenceKevin Xia, Kai-Zhan Lee, Yoshua Bengio, Elias BareinboimNeurIPS 2021 · 158 citations
- On Measuring Causal Contributions via do-interventionsYonghan Jung, Shiva Prasad Kasiviswanathan, Jin Tian, Dominik Janzing et al.ICML 2022 · 36 citations
- Estimating Identifiable Causal Effects on Markov Equivalence Class through Double Machine LearningYonghan Jung, Jin Tian, Elias BareinboimICML 2021 · 21 citations
- Adversarial Counterfactual Environment Model LearningXiong-Hui Chen, Yang Yu, Zhengmao Zhu, Zhihua Yu et al.NeurIPS 2023 · 20 citations
- Neural Causal AbstractionsKevin Xia, Elias BareinboimAAAI 2024 · 17 citations
Builds on1
Related papers
- Estimating Identifiable Causal Effects through Double Machine LearningYonghan Jung, Jin Tian, Elias BareinboimAAAI 2021 · 70 citations
- Estimating Causal Effects Identifiable from a Combination of Observations and ExperimentsYonghan Jung, Ivan Diaz, Jin Tian, Elias BareinboimNeurIPS 2023 · 7 citations
- Causal Inference with Conditional Front-Door Adjustment and Identifiable Variational AutoencoderZiqi Xu, Debo Cheng, Jiuyong Li, Jixue Liu et al.ICLR 2024 · 26 citations
- Causal Effect Identifiability under Partial-ObservabilitySanghack Lee, Elias BareinboimICML 2020 · 26 citations
- Identifying Causal Effects Under Functional DependenciesYizuo Chen, Adnan DarwicheNeurIPS 2024 · 8 citations
