Identification of Nonlinear Latent Hierarchical Models
Lingjing Kong, Biwei Huang, Feng Xie, Eric P. Xing, Yuejie Chi, Kun Zhang
摘要
Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be highly challenging, especially when observed variables are generated by causally related latent variables and the relationships are nonlinear. In this work, we investigate the identification problem for nonlinear latent hierarchical causal models in which observed variables are generated by a set of causally related latent variables, and some latent variables may not have observed children. We show that the identifiability of causal structures and latent variables (up to invertible transformations) can be achieved under mild assumptions: on causal structures, we allow for multiple paths between any pair of variables in the graph, which relaxes latent tree assumptions in prior work; on structural functions, we permit general nonlinearity and multi-dimensional continuous variables, alleviating existing work's parametric assumptions. Specifically, we first develop an identification criterion in the form of novel identifiability guarantees for an elementary latent variable model. Leveraging this criterion, we show that both causal structures and latent variables of the hierarchical model can be identified asymptotically by explicitly constructing an estimation procedure. To the best of our knowledge, our work is the first to establish identifiability guarantees for both causal structures and latent variables in nonlinear latent hierarchical models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper22
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava 等NeurIPS 2023 · 被引用 120 次
- Learning World Models with Identifiable FactorizationYuren Liu, Biwei Huang, Zhengmao Zhu, Hong-Long Tian 等NeurIPS 2023 · 被引用 32 次
- Learning Discrete Concepts in Latent Hierarchical ModelsLingjing Kong, Guangyi Chen, Biwei Huang, Eric P. Xing 等NeurIPS 2024 · 被引用 20 次
- Identifying Representations for Intervention ExtrapolationSorawit Saengkyongam, Elan Rosenfeld, Pradeep Kumar Ravikumar, Niklas Pfister 等ICLR 2024 · 被引用 20 次
- Counterfactual Generation with Identifiability GuaranteesHanqi Yan, Lingjing Kong, Lin Gui, Yuejie Chi 等NeurIPS 2023 · 被引用 16 次
它引用的顶会 Paper18
- Self-Supervised Learning with Data Augmentations Provably Isolates Content from StyleJulius von Kügelgen, Yash Sharma, Luigi Gresele, Wieland Brendel 等NeurIPS 2021 · 被引用 421 次
- Interventional Causal Representation LearningKartik Ahuja, Divyat Mahajan, Yixin Wang, Yoshua BengioICML 2023 · 被引用 143 次
- Identifiability Guarantees for Causal Disentanglement from Soft InterventionsJiaqi Zhang, Kristjan H. Greenewald, Chandler Squires, Akash Srivastava 等NeurIPS 2023 · 被引用 120 次
- Generalized Independent Noise Condition for Estimating Latent Variable Causal GraphsFeng Xie, Ruichu Cai, Biwei Huang, Clark Glymour 等NeurIPS 2020 · 被引用 119 次
- Learning Linear Causal Representations from Interventions under General Nonlinear MixingSimon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam 等NeurIPS 2023 · 被引用 113 次
相关 Paper
- Differentiable Causal Discovery for Latent Hierarchical Causal ModelsParjanya Prajakta Prashant, Ignavier Ng, Kun Zhang, Biwei HuangICLR 2025
- Latent Hierarchical Causal Structure Discovery with Rank ConstraintsBiwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour 等NeurIPS 2022 · 被引用 78 次
- Identification of Linear Non-Gaussian Latent Hierarchical StructureFeng Xie, Biwei Huang, Zhengming Chen, Yangbo He 等ICML 2022 · 被引用 65 次
- Causal Structure Recovery with Latent Variables under Milder Distributional and Graphical AssumptionsXiu-Chuan Li, Kun Zhang, Tongliang LiuICLR 2024 · 被引用 5 次
- Learning latent causal graphs via mixture oraclesBohdan Kivva, Goutham Rajendran, Pradeep Ravikumar, Bryon AragamNeurIPS 2021 · 被引用 66 次
