Identifiability Guarantees for Causal Disentanglement from Soft Interventions
Jiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava, Karthikeyan Shanmugam, Caroline Uhler
Abstract
Causal disentanglement aims to uncover a representation of data using latent variables that are interrelated through a causal model. Such a representation is identifiable if the latent model that explains the data is unique. In this paper, we focus on the scenario where unpaired observational and interventional data are available, with each intervention changing the mechanism of a latent variable. When the causal variables are fully observed, statistically consistent algorithms have been developed to identify the causal model under faithfulness assumptions. We here show that identifiability can still be achieved with unobserved causal variables, given a generalized notion of faithfulness. Our results guarantee that we can recover the latent causal model up to an equivalence class and predict the effect of unseen combinations of interventions, in the limit of infinite data. We implement our causal disentanglement framework by developing an autoencoding variational Bayes algorithm and apply it to the problem of predicting combinatorial perturbation effects in genomics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers47
- Learning Linear Causal Representations from Interventions under General Nonlinear MixingSimon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam et al.NeurIPS 2023 · 113 citations
- Multi-View Causal Representation Learning with Partial ObservabilityDingling Yao, Danru Xu, Sébastien Lachapelle, Sara Magliacane et al.ICLR 2024 · 70 citations
- Causal Representation Learning from Multiple Distributions: A General SettingKun Zhang, Shaoan Xie, Ignavier Ng, Yujia ZhengICML 2024 · 61 citations
- Additive Decoders for Latent Variables Identification and Cartesian-Product ExtrapolationSébastien Lachapelle, Divyat Mahajan, Ioannis Mitliagkas, Simon Lacoste-JulienNeurIPS 2023 · 61 citations
- Learning Nonparametric Latent Causal Graphs with Unknown InterventionsYibo Jiang, Bryon AragamNeurIPS 2023 · 39 citations
Builds on20
- Deep Structural Causal Models for Tractable Counterfactual InferenceNick Pawlowski, Daniel Coelho de Castro, Ben GlockerNeurIPS 2020 · 353 citations
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 337 citations
- Contrastive Learning Inverts the Data Generating ProcessRoland S. Zimmermann, Yash Sharma, Steffen Schneider, Matthias Bethge et al.ICML 2021 · 264 citations
- Weakly supervised causal representation learningJohann Brehmer, Pim de Haan, Phillip Lippe, Taco S. CohenNeurIPS 2022 · 196 citations
- DiBS: Differentiable Bayesian Structure LearningLars Lorch, Jonas Rothfuss, Bernhard Schölkopf, Andreas KrauseNeurIPS 2021 · 144 citations
Related papers
- Linear Causal Disentanglement via InterventionsChandler Squires, Anna Seigal, Salil S. Bhate, Caroline UhlerICML 2023 · 90 citations
- Identifiability Guarantees for Causal Disentanglement from Purely Observational DataRyan Welch, Jiaqi Zhang, Caroline UhlerNeurIPS 2024 · 8 citations
- CausalVAE: Disentangled Representation Learning via Neural Structural Causal ModelsMengyue Yang, Furui Liu, Zhitang Chen, Xinwei Shen et al.CVPR 2021
- Nonlinear Causal Discovery with Latent ConfoundersDavid Kaltenpoth, Jilles VreekenICML 2023 · 22 citations
- Counterfactual Fairness with Disentangled Causal Effect Variational AutoencoderHyemi Kim, Seungjae Shin, JoonHo Jang, Kyungwoo Song et al.AAAI 2021 · 72 citations
