DISCO: Mitigating Bias in Deep Learning with Conditional Distance Correlation
Emre Kavak, Tom Nuno Wolf, Christian Wachinger
Abstract
Dataset bias often leads deep learning models to exploit spurious correlations instead of taskrelevant signals. We introduce the Standard Anti-Causal Model (SAM), a unifying causal framework that characterizes bias mechanisms and yields a conditional independence criterion for causal stability. Building on this theory, we propose DISCO m and sDISCO, efficient and scalable estimators of conditional distance correlation that enable independence regularization in gradient-based models. Across six diverse datasets, our methods consistently outperform or are competitive in existing observed bias mitigation approaches, while requiring fewer hyperparameters and scaling seamlessly to multi-bias scenarios. This work bridges causal theory and practical deep learning, providing both a principled foundation and effective tools for robust prediction. Source Code: https://github. com/yakamoz5/DISCO .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5113723-6bdb-499e-b53d-3f98723a7727Builds on7
- Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image RepresentationsTianlu Wang, Jieyu Zhao, Mark Yatskar, Kai-Wei Chang et al.ICCV 2019 · 469 citations
- Out-of-distribution Generalization in the Presence of Nuisance-Induced Spurious CorrelationsAahlad Manas Puli, Lily H. Zhang, Eric Karl Oermann, Rajesh RanganathICLR 2022 · 54 citations
- Nested Counterfactual Identification from Arbitrary Surrogate ExperimentsJuan D. Correa, Sanghack Lee, Elias BareinboimNeurIPS 2021 · 48 citations
- Vision-and-Language Navigation via Causal LearningLiuyi Wang, Zongtao He, Ronghao Dang, Mengjiao Shen et al.CVPR 2024 · 24 citations
- Deep Learning Methods for Proximal Inference via Maximum Moment RestrictionBenjamin Kompa, David R. Bellamy, Thomas Kolokotrones, James M. Robins et al.NeurIPS 2022 · 22 citations
Related papers
- Causal Effect Regularization: Automated Detection and Removal of Spurious CorrelationsAbhinav Kumar, Amit Deshpande, Amit SharmaNeurIPS 2023 · 7 citations
- Information-Theoretic Bias Reduction via Causal View of Spurious CorrelationSeonguk Seo, Joon-Young Lee, Bohyung HanAAAI 2022 · 29 citations
- Efficient Conditionally Invariant Representation LearningRoman Pogodin, Namrata Deka, Yazhe Li, Danica J. Sutherland et al.ICLR 2023 · 2 citations
- Counterfactual Maximum Likelihood Estimation for Training Deep NetworksXinyi Wang, Wenhu Chen, Michael Saxon, William Yang WangNeurIPS 2021 · 9 citations
- De-biasing Distantly Supervised Named Entity Recognition via Causal InterventionWenkai Zhang, Hongyu Lin, Xianpei Han, Le SunACL 2021
