Differentiable Causal Discovery for Latent Hierarchical Causal Models
Parjanya Prajakta Prashant, Ignavier Ng, Kun Zhang, Biwei Huang
Abstract
Discovering causal structures with latent variables from observational data is a fundamental challenge in causal discovery. Existing methods often rely on constraintbased, iterative discrete searches, limiting their scalability to large numbers of variables. Moreover, these methods frequently assume linearity or invertibility, restricting their applicability to real-world scenarios. We present new theoretical results on the identifiability of nonlinear latent hierarchical causal models, relaxing previous assumptions in literature about the deterministic nature of latent variables and exogenous noise. Building on these insights, we develop a novel differentiable causal discovery algorithm that efficiently estimates the structure of such models. To the best of our knowledge, this is the first work to propose a differentiable causal discovery method for nonlinear latent hierarchical models. Our approach outperforms existing methods in both accuracy and scalability. We demonstrate its practical utility by learning interpretable hierarchical latent structures from high-dimensional image data and demonstrate its effectiveness on downstream tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 073afc9a-7069-478a-b1b7-6ad2e1c994fdCited by top-tier papers2
- TabStruct: Measuring Structural Fidelity of Tabular DataXiangjian Jiang, Nikola Simidjievski, Mateja JamnikICLR 2026 · 10 citations
- On the Identifiability of Poisson Branching Structural Causal Model Under Latent ConfoundingJie Qiao, Zihuai Zeng, Ruichu Cai, Zhengming Chen et al.ICML 2026
Builds on13
- NVAE: A Deep Hierarchical Variational AutoencoderArash Vahdat, Jan KautzNeurIPS 2020 · 1,141 citations
- Differentiable Causal Discovery from Interventional DataPhilippe Brouillard, Sébastien Lachapelle, Alexandre Lacoste, Simon Lacoste-Julien et al.NeurIPS 2020 · 295 citations
- Generalized Independent Noise Condition for Estimating Latent Variable Causal GraphsFeng Xie, Ruichu Cai, Biwei Huang, Clark Glymour et al.NeurIPS 2020 · 119 citations
- On the Identifiability of Nonlinear ICA: Sparsity and BeyondYujia Zheng, Ignavier Ng, Kun ZhangNeurIPS 2022 · 104 citations
- Latent Hierarchical Causal Structure Discovery with Rank ConstraintsBiwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour et al.NeurIPS 2022 · 78 citations
Related papers
- Identification of Nonlinear Latent Hierarchical ModelsLingjing Kong, Biwei Huang, Feng Xie, Eric P. Xing et al.NeurIPS 2023 · 33 citations
- Identifiability Guarantees for Causal Disentanglement from Purely Observational DataRyan Welch, Jiaqi Zhang, Caroline UhlerNeurIPS 2024 · 8 citations
- Causal Structure Recovery with Latent Variables under Milder Distributional and Graphical AssumptionsXiu-Chuan Li, Kun Zhang, Tongliang LiuICLR 2024 · 5 citations
- Nonlinear Causal Discovery with Latent ConfoundersDavid Kaltenpoth, Jilles VreekenICML 2023 · 22 citations
- Distributional Equivalence in Linear Non-Gaussian Latent-Variable Cyclic Causal Models: Characterization and LearningHaoyue Dai, Immanuel Albrecht, Peter Spirtes, Kun ZhangICLR 2026 · 4 citations
