Score Matching Enables Causal Discovery of Nonlinear Additive Noise Models
Paul Rolland, Volkan Cevher, Matthäus Kleindessner, Chris Russell, Dominik Janzing, Bernhard Schölkopf, Francesco Locatello
Abstract
This paper demonstrates how to recover causal graphs from the score of the data distribution in non-linear additive (Gaussian) noise models. Using score matching algorithms as a building block, we show how to design a new generation of scalable causal discovery methods. To showcase our approach, we also propose a new efficient method for approximating the score's Jacobian, enabling to recover the causal graph. Empirically, we find that the new algorithm, called SCORE, is competitive with state-of-the-art causal discovery methods while being significantly faster.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9c2daf4a-20bb-4898-b391-d8c515fb3fbfCited by top-tier papers47
- A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise ModelsAlexander G. Reisach, Myriam Tami, Christof Seiler, Antoine Chambaz et al.NeurIPS 2023 · 40 citations
- Assumption violations in causal discovery and the robustness of score matchingFrancesco Montagna, Atalanti-Anastasia Mastakouri, Elias Eulig, Nicoletta Noceti et al.NeurIPS 2023 · 35 citations
- Stable Differentiable Causal DiscoveryAchille Nazaret, Justin Hong, Elham Azizi, David M. BleiICML 2024 · 29 citations
- Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative ModelingZhenyu Zhu, Francesco Locatello, Volkan CevherNeurIPS 2023 · 23 citations
- Toward Falsifying Causal Graphs Using a Permutation-Based TestElias Eulig, Atalanti-Anastasia Mastakouri, Patrick Blöbaum, Michaela Hardt et al.AAAI 2025 · 21 citations
Builds on4
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 337 citations
- Causal Discovery with Reinforcement LearningShengyu Zhu, Ignavier Ng, Zhitang ChenICLR 2020 · 285 citations
Related papers
- Ordering-based Causal Discovery via Generalized Score MatchingVy Vo, Trung Le, He Zhao, Edwin V. Bonilla et al.KDD 2026 · 1 citation
- Score-informed Neural Operator for Enhancing Ordering-based Causal DiscoveryJiyeon Kang, Songseong Kim, Chanhui Lee, Doyeong Hwang et al.NeurIPS 2025 · 2 citations
- Fast Causal Discovery by Approximate Kernel-based Generalized Score Functions with Linear Computational ComplexityYixin Ren, Haocheng Zhang, Yewei Xia, Hao Zhang et al.KDD 2025 · 1 citation
- Distinguishing Cause from Effect with Causal Velocity ModelsJohnny Xi, Hugh Dance, Peter Orbanz, Benjamin Bloem-ReddyICML 2025
- Boosting Causal Discovery via Adaptive Sample ReweightingAn Zhang, Fangfu Liu, Wenchang Ma, Zhibo Cai et al.ICLR 2023 · 4 citations
