Linear Causal Disentanglement via Interventions
Chandler Squires, Anna Seigal, Salil S. Bhate, Caroline Uhler
Abstract
Causal disentanglement seeks a representation of data involving latent variables that are related via a causal model. A representation is identifiable if both the latent model and the transformation from latent to observed variables are unique. In this paper, we study observed variables that are a linear transformation of a linear latent causal model. Data from interventions are necessary for identifiability: if one latent variable is missing an intervention, we show that there exist distinct models that cannot be distinguished. Conversely, we show that a single intervention on each latent variable is sufficient for identifiability. Our proof uses a generalization of the RQ decomposition of a matrix that replaces the usual orthogonal and upper triangular conditions with analogues depending on a partial order on the rows of the matrix, with partial order determined by a latent causal model. We corroborate our theoretical results with a method for causal disentanglement. We show that the method accurately recovers a latent causal model on synthetic and semi-synthetic data and we illustrate a use case on a dataset of single-cell RNA sequencing measurements.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fec9399c-e1f6-4b30-beb2-0d41853d84cfCited by top-tier papers55
- Interventional Causal Representation LearningKartik Ahuja, Divyat Mahajan, Yixin Wang, Yoshua BengioICML 2023 · 143 citations
- Nonparametric Identifiability of Causal Representations from Unknown InterventionsJulius von Kügelgen, Michel Besserve, Wendong Liang, Luigi Gresele et al.NeurIPS 2023 · 127 citations
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava et al.NeurIPS 2023 · 120 citations
- Learning Linear Causal Representations from Interventions under General Nonlinear MixingSimon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam et al.NeurIPS 2023 · 113 citations
- Multi-View Causal Representation Learning with Partial ObservabilityDingling Yao, Danru Xu, Sébastien Lachapelle, Sara Magliacane et al.ICLR 2024 · 70 citations
Builds on10
- Contrastive Learning Inverts the Data Generating ProcessRoland S. Zimmermann, Yash Sharma, Steffen Schneider, Matthias Bethge et al.ICML 2021 · 264 citations
- Weakly supervised causal representation learningJohann Brehmer, Pim de Haan, Phillip Lippe, Taco S. CohenNeurIPS 2022 · 196 citations
- Interventional Causal Representation LearningKartik Ahuja, Divyat Mahajan, Yixin Wang, Yoshua BengioICML 2023 · 143 citations
- Causal Discovery from Soft Interventions with Unknown Targets: Characterization and LearningAmin Jaber, Murat Kocaoglu, Karthikeyan Shanmugam, Elias BareinboimNeurIPS 2020 · 136 citations
- Generalized Independent Noise Condition for Estimating Latent Variable Causal GraphsFeng Xie, Ruichu Cai, Biwei Huang, Clark Glymour et al.NeurIPS 2020 · 119 citations
Related papers
- Identifiability Guarantees for Causal Disentanglement from Purely Observational DataRyan Welch, Jiaqi Zhang, Caroline UhlerNeurIPS 2024 · 8 citations
- Variational Learning of Disentangled RepresentationsYuli Slavutsky, Ozgur Beker, David Blei, Bianca DumitrascuICML 2026 · 1 citation
- Linear Causal Representation Learning from Unknown Multi-node InterventionsBurak Varici, Emre Acartürk, Karthikeyan Shanmugam, Ali TajerNeurIPS 2024 · 19 citations
- Learning Nonparametric Latent Causal Graphs with Unknown InterventionsYibo Jiang, Bryon AragamNeurIPS 2023 · 39 citations
- Learning Mixtures of Unknown Causal InterventionsAbhinav Kumar, Kirankumar Shiragur, Caroline UhlerNeurIPS 2024 · 1 citation
