Towards Learning and Explaining Indirect Causal Effects in Neural Networks
Abbavaram Gowtham Reddy, Saketh Bachu, Harsharaj Pathak, Benin Godfrey L, Varshaneya V, Vineeth N. Balasubramanian, Satyanarayan Kar
Abstract
Recently, there has been a growing interest in learning and explaining causal effects within Neural Network (NN) models. By virtue of NN architectures, previous approaches consider only direct and total causal effects assuming independence among input variables. We view an NN as a structural causal model (SCM) and extend our focus to include indirect causal effects by introducing feedforward connections among input neurons. We propose an ante-hoc method that captures and maintains direct, indirect, and total causal effects during NN model training. We also propose an algorithm for quantifying learned causal effects in an NN model and efficient approximation strategies for quantifying causal effects in high-dimensional data. Extensive experiments conducted on synthetic and real-world datasets demonstrate that the causal effects learned by our ante-hoc method better approximate the ground truth effects compared to existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b9dc877b-896b-4cc4-9bcd-4e96a9c8759aBuilds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Investigating Gender Bias in Language Models Using Causal Mediation AnalysisJesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian et al.NeurIPS 2020 · 851 citations
- Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning SystemsAnupam Datta, Shayak Sen, Yair ZickS&P 2016 · 774 citations
- Recurrent Independent MechanismsAnirudh Goyal, Alex Lamb, Jordan Hoffmann, Shagun Sodhani et al.ICLR 2021 · 357 citations
- Deep Structural Causal Models for Tractable Counterfactual InferenceNick Pawlowski, Daniel Coelho de Castro, Ben GlockerNeurIPS 2020 · 353 citations
Related papers
- Matching Learned Causal Effects of Neural Networks with Domain PriorsSai Srinivas Kancheti, Abbavaram Gowtham Reddy, Vineeth N. Balasubramanian, Amit SharmaICML 2022 · 17 citations
- The Causal-Neural Connection: Expressiveness, Learnability, and InferenceKevin Xia, Kai-Zhan Lee, Yoshua Bengio, Elias BareinboimNeurIPS 2021 · 158 citations
- CASTLE: Regularization via Auxiliary Causal Graph DiscoveryTrent Kyono, Yao Zhang, Mihaela van der SchaarNeurIPS 2020 · 82 citations
- Consistency of Neural Causal Partial IdentificationJiyuan Tan, Jose H. Blanchet, Vasilis SyrgkanisNeurIPS 2024 · 4 citations
- CC: Causality-Aware Coverage Criterion for Deep Neural NetworksZhenlan Ji, Pingchuan Ma, Yuanyuan Yuan, Shuai WangICSE 2023 · 12 citations
