Identifiable Nonlinear Differentiable Causal Discovery via Independence and Adaptive Group Sparsity
Ruicong Yao, Tim Verdonck, Mihaela van der Schaar, Jakob Raymaekers
摘要
Differentiable approaches to causal discovery have shown promise in learning DAG structures via continuous optimization, but their theoretical guarantees are largely restricted to models with homoscedastic noise or known noise distribution. In particular, existing methods based on mean squared error fail to identify the true DAG when noise distributions are non-Gaussian and vary in scale. In this paper, we address this gap in nonlinear additive noise models (ANMs) with arbitrary noise. Our approach extends NOTIME (Berrevoets et al., 2025) which minimizes an independence criterion among the residuals. We show that the global minimizer of the independence criterion corresponds to the true underlying DAG up to additional constant edges in general ANMs. To recover the exact structure, we introduce an adaptive group lasso penalty that regularizes entire columns of the first-layer weight matrix of an MLP, enabling the selective pruning of constant edges in a functionally meaningful way. Empirically, our method achieves effective and stable performance across diverse noise types and variances, outperforming prior methods that lack identifiability guarantees in this setting.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 被引用 337 次
- On the Role of Sparsity and DAG Constraints for Learning Linear DAGsIgnavier Ng, AmirEmad Ghassami, Kun ZhangNeurIPS 2020 · 被引用 306 次
- Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy to GameAlexander G. Reisach, Christof Seiler, Sebastian WeichwaldNeurIPS 2021 · 被引用 213 次
- Score Matching Enables Causal Discovery of Nonlinear Additive Noise ModelsPaul Rolland, Volkan Cevher, Matthäus Kleindessner, Chris Russell 等ICML 2022 · 被引用 123 次
- DAGs with No Fears: A Closer Look at Continuous Optimization for Learning Bayesian NetworksDennis Wei, Tian Gao, Yue YuNeurIPS 2020 · 被引用 102 次
相关 Paper
- DARING: Differentiable Causal Discovery with Residual IndependenceYue He, Peng Cui, Zheyan Shen, Renzhe Xu 等KDD 2021 · 被引用 28 次
- Stabilizing Causal Structure Learning under Heteroscedasticity: Analysis and Mitigation of Optimization FailuresEunjung Choi, Seonggyeom Kim, Dong-Kyu ChaeKDD 2026
- Boosting Causal Discovery via Adaptive Sample ReweightingAn Zhang, Fangfu Liu, Wenchang Ma, Zhibo Cai 等ICLR 2023 · 被引用 4 次
- Effective Causal Discovery under Identifiable Heteroscedastic Noise ModelNaiyu Yin, Tian Gao, Yue Yu, Qiang JiAAAI 2024 · 被引用 5 次
- Strong and Weak Identifiability of Optimization-based Causal Discovery in Non-linear Additive Noise ModelsMingjia Li, Hong Qian, Tian-Zuo Wang, Shujun Li 等ICML 2025
