Causal Discovery in the Wild: A Voting-Theoretic Ensemble Approach
Vy Vo, Haoxuan Li, Mingming Gong
Abstract
Causal discovery is a critical yet persistently challenging task across scientific domains. Despite years of significant algorithmic advances, existing methods still struggle with inconsistent outcomes due to reliance on untestable assumptions, sensitivity to data perturbations, and optimization constraints. To this end, ensemble-based causal discovery has been actively pursued, aiming to aggregate multiple structural predictions for increased stability and uncertainty estimation. However, current aggregation methods are largely heuristic, lacking theoretical guarantees and guidance on how ensemble design choices affect performance. This work is proposed to address there fundamental limitations. We introduce a principled voting-based framework for structural ensembling, establishing conditions under which the aggregated structure recovers the true causal graph. Our analysis yields a theoretically justified weighted voting mechanism that informs optimal choices regarding the number, competency, and diversity of causal discovery experts in the ensemble. Extensive experiments on synthetic and real-world datasets verify the robustness and effectiveness of our approach, offering a rigorous alternative to existing heuristic ensemble methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1d119c03-d560-4964-b50f-98faf735591bBuilds on9
- Gradient-Based Neural DAG LearningSébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-JulienICLR 2020 · 337 citations
- DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity CharacterizationKevin Bello, Bryon Aragam, Pradeep RavikumarNeurIPS 2022 · 222 citations
- DiBS: Differentiable Bayesian Structure LearningLars Lorch, Jonas Rothfuss, Bernhard Schölkopf, Andreas KrauseNeurIPS 2021 · 144 citations
- Score Matching Enables Causal Discovery of Nonlinear Additive Noise ModelsPaul Rolland, Volkan Cevher, Matthäus Kleindessner, Chris Russell et al.ICML 2022 · 123 citations
- Identifiability of Label Noise Transition MatrixYang Liu, Hao Cheng, Kun ZhangICML 2023 · 58 citations
Related papers
- Efficient Ensemble Conditional Independence Test Framework for Causal DiscoveryZhengkang Guan, Kun KuangICLR 2026 · 6 citations
- Ensembling Graph Predictions for AMR ParsingThanh Lam Hoang, Gabriele Picco, Yufang Hou, Young-Suk Lee et al.NeurIPS 2021 · 29 citations
- Federated Causality Learning with Explainable Adaptive OptimizationDezhi Yang, Xintong He, Jun Wang, Guoxian Yu et al.AAAI 2024 · 21 citations
- Assumption violations in causal discovery and the robustness of score matchingFrancesco Montagna, Atalanti-Anastasia Mastakouri, Elias Eulig, Nicoletta Noceti et al.NeurIPS 2023 · 35 citations
- Sparse Additive Model Pruning for Order-Based Causal Structure LearningKentaro Kanamori, Hirofumi Suzuki, Takuya TakagiAAAI 2026
