Identification of Nonlinear Latent Hierarchical Models
Lingjing Kong, Biwei Huang, Feng Xie, Eric P. Xing, Yuejie Chi, Kun Zhang
Abstract
Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be highly challenging, especially when observed variables are generated by causally related latent variables and the relationships are nonlinear. In this work, we investigate the identification problem for nonlinear latent hierarchical causal models in which observed variables are generated by a set of causally related latent variables, and some latent variables may not have observed children. We show that the identifiability of causal structures and latent variables (up to invertible transformations) can be achieved under mild assumptions: on causal structures, we allow for multiple paths between any pair of variables in the graph, which relaxes latent tree assumptions in prior work; on structural functions, we permit general nonlinearity and multi-dimensional continuous variables, alleviating existing work's parametric assumptions. Specifically, we first develop an identification criterion in the form of novel identifiability guarantees for an elementary latent variable model. Leveraging this criterion, we show that both causal structures and latent variables of the hierarchical model can be identified asymptotically by explicitly constructing an estimation procedure. To the best of our knowledge, our work is the first to establish identifiability guarantees for both causal structures and latent variables in nonlinear latent hierarchical models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers22
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava et al.NeurIPS 2023 · 120 citations
- Learning World Models with Identifiable FactorizationYuren Liu, Biwei Huang, Zhengmao Zhu, Hong-Long Tian et al.NeurIPS 2023 · 32 citations
- Learning Discrete Concepts in Latent Hierarchical ModelsLingjing Kong, Guangyi Chen, Biwei Huang, Eric P. Xing et al.NeurIPS 2024 · 20 citations
- Identifying Representations for Intervention ExtrapolationSorawit Saengkyongam, Elan Rosenfeld, Pradeep Kumar Ravikumar, Niklas Pfister et al.ICLR 2024 · 20 citations
- Counterfactual Generation with Identifiability GuaranteesHanqi Yan, Lingjing Kong, Lin Gui, Yuejie Chi et al.NeurIPS 2023 · 16 citations
Builds on18
- Self-Supervised Learning with Data Augmentations Provably Isolates Content from StyleJulius von Kügelgen, Yash Sharma, Luigi Gresele, Wieland Brendel et al.NeurIPS 2021 · 421 citations
- Interventional Causal Representation LearningKartik Ahuja, Divyat Mahajan, Yixin Wang, Yoshua BengioICML 2023 · 143 citations
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava et al.NeurIPS 2023 · 120 citations
- Generalized Independent Noise Condition for Estimating Latent Variable Causal GraphsFeng Xie, Ruichu Cai, Biwei Huang, Clark Glymour et al.NeurIPS 2020 · 119 citations
- Learning Linear Causal Representations from Interventions under General Nonlinear MixingSimon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam et al.NeurIPS 2023 · 113 citations
Related papers
- Differentiable Causal Discovery for Latent Hierarchical Causal ModelsParjanya Prajakta Prashant, Ignavier Ng, Kun Zhang, Biwei HuangICLR 2025
- Latent Hierarchical Causal Structure Discovery with Rank ConstraintsBiwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour et al.NeurIPS 2022 · 78 citations
- Identification of Linear Non-Gaussian Latent Hierarchical StructureFeng Xie, Biwei Huang, Zhengming Chen, Yangbo He et al.ICML 2022 · 65 citations
- Causal Structure Recovery with Latent Variables under Milder Distributional and Graphical AssumptionsXiu-Chuan Li, Kun Zhang, Tongliang LiuICLR 2024 · 5 citations
- Learning latent causal graphs via mixture oraclesBohdan Kivva, Goutham Rajendran, Pradeep Ravikumar, Bryon AragamNeurIPS 2021 · 66 citations
