Inferring Cause and Effect in the Presence of Heteroscedastic Noise
Sascha Xu, Osman Mian, Alexander Marx, Jilles Vreeken
Abstract
We study the problem of identifying cause and effect over two univariate continuous variables X and Y from a sample of their joint distribution. Our focus lies on the setting when the variance of the noise may be dependent on the cause. We propose to partition the domain of the cause into multiple segments where the noise indeed is dependent. To this end, we minimize a scale-invariant, penalized regression score, finding the optimal partitioning using dynamic programming. We show under which conditions this allows us to identify the causal direction for the linear setting with heteroscedastic noise, for the non-linear setting with homoscedastic noise, as well as empirically confirm that these results generalize to the non-linear and heteroscedastic case. Altogether, the ability to model heteroscedasticity translates into an improved performance in telling cause from effect on a wide range of synthetic and real-world datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- On the Identifiability and Estimation of Causal Location-Scale Noise ModelsAlexander Immer, Christoph Schultheiss, Julia E. Vogt, Bernhard Schölkopf et al.ICML 2023 · 56 citations
- A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise ModelsAlexander G. Reisach, Myriam Tami, Christof Seiler, Antoine Chambaz et al.NeurIPS 2023 · 40 citations
- Effective Bayesian Heteroscedastic Regression with Deep Neural NetworksAlexander Immer, Emanuele Palumbo, Alexander Marx, Julia E. VogtNeurIPS 2023 · 34 citations
- Causal Discovery from Event Sequences by Local Cause-Effect AttributionJoscha Cüppers, Sascha Xu, Ahmed Musa, Jilles VreekenNeurIPS 2024 · 13 citations
- Cause-Effect Inference in Location-Scale Noise Models: Maximum Likelihood vs. Independence TestingXiangyu Sun, Oliver SchulteNeurIPS 2023 · 10 citations
Builds on5
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 337 citations
- On the Role of Sparsity and DAG Constraints for Learning Linear DAGsIgnavier Ng, AmirEmad Ghassami, Kun ZhangNeurIPS 2020 · 306 citations
- Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy to GameAlexander G. Reisach, Christof Seiler, Sebastian WeichwaldNeurIPS 2021 · 213 citations
- Distinguishing Cause from Effect Using Quantiles: Bivariate Quantile Causal DiscoveryNatasa Tagasovska, Valérie Chavez-Demoulin, Thibault VatterICML 2020 · 50 citations
- Discovering Fully Oriented Causal NetworksOsman Mian, Alexander Marx, Jilles VreekenAAAI 2021 · 37 citations
Related papers
- A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal DiscoveryYingyu Lin, Yuxing Huang, Wenqin Liu, Haoran Deng et al.ICLR 2025
- Causal Discovery via Quantile Partial EffectYikang Chen, Xingzhe Sun, Dehui duICLR 2026 · 3 citations
- Flow based approach for Dynamic Temporal Causal models with non-Gaussian or Heteroscedastic NoisesAbdellah Rahmani, Pascal FrossardNeurIPS 2025 · 3 citations
- Distinguishing Cause from Effect with Causal Velocity ModelsJohnny Xi, Hugh Dance, Peter Orbanz, Benjamin Bloem-ReddyICML 2025
- Effective Causal Discovery under Identifiable Heteroscedastic Noise ModelNaiyu Yin, Tian Gao, Yue Yu, Qiang JiAAAI 2024 · 5 citations
