Resolution of Simpson's paradox via the common cause principle
Arshak Hovhannisyan, Armen E. Allahverdyan
Abstract
Simpson's paradox is an obstacle to establishing a probabilistic association between two events and , given the third (lurking) random variable . We focus on scenarios when the random variables (which combines , , and their complements) and have a common cause that need not be observed. Alternatively, we can assume that screens out from . For such cases, the correct association between and is to be defined via conditioning over . This setup generalizes the original Simpson's paradox: now its two contradicting options refer to two particular and different causes . We show that if and are binary and is quaternary (the minimal and the most widespread situation for the Simpson's paradox), the conditioning over any binary common cause establishes the same direction of association between and as the conditioning over in the original formulation of the paradox. Thus, for the minimal common cause, one should choose the option of Simpson's paradox that assumes conditioning over and not its marginalization. The same conclusion is reached when Simpson's paradox is formulated via 3 continuous Gaussian variables: within the minimal formulation of the paradox (3 scalar continuous variables , , and ), one should choose the option with the conditioning over .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on2
- Applications of Common Entropy for Causal InferenceMurat Kocaoglu, Sanjay Shakkottai, Alexandros G. Dimakis, Constantine Caramanis et al.NeurIPS 2020 · 22 citations
- Detecting and Measuring Confounding Using Causal Mechanism ShiftsAbbavaram Gowtham Reddy, Vineeth N. BalasubramanianNeurIPS 2024 · 7 citations
Related papers
- Finding Non-Redundant Simpson's Paradox in Multidimensional DataYi Yang, Jian Pei, Jun Yang, Jichun XieVLDB 2026
- A Sample Efficient Conditional Independence Test in the Presence of DiscretizationBoyang Sun, Yu Yao, Xinshuai Dong, Zongfang Liu et al.ICML 2025
- A Conditional Independence Test in the Presence of DiscretizationBoyang Sun, Yu Yao, Guang-Yuan Hao, Yumou Qiu et al.ICLR 2025
- Compositional Semantics for Probabilistic Programs with Exact ConditioningDario Stein, Sam StatonLICS 2021 · 18 citations
- SoK: Differential Privacy as a Causal PropertyMichael Carl Tschantz, Shayak Sen, Anupam DattaS&P 2020 · 49 citations
