DISCO: Mitigating Bias in Deep Learning with Conditional Distance Correlation
Emre Kavak, Tom Nuno Wolf, Christian Wachinger
摘要
Dataset bias often leads deep learning models to exploit spurious correlations instead of taskrelevant signals. We introduce the Standard Anti-Causal Model (SAM), a unifying causal framework that characterizes bias mechanisms and yields a conditional independence criterion for causal stability. Building on this theory, we propose DISCO m and sDISCO, efficient and scalable estimators of conditional distance correlation that enable independence regularization in gradient-based models. Across six diverse datasets, our methods consistently outperform or are competitive in existing observed bias mitigation approaches, while requiring fewer hyperparameters and scaling seamlessly to multi-bias scenarios. This work bridges causal theory and practical deep learning, providing both a principled foundation and effective tools for robust prediction. Source Code: https://github. com/yakamoz5/DISCO .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image RepresentationsTianlu Wang, Jieyu Zhao, Mark Yatskar, Kai-Wei Chang 等ICCV 2019 · 被引用 469 次
- Out-of-distribution Generalization in the Presence of Nuisance-Induced Spurious CorrelationsAahlad Manas Puli, Lily H. Zhang, Eric Karl Oermann, Rajesh RanganathICLR 2022 · 被引用 54 次
- Nested Counterfactual Identification from Arbitrary Surrogate ExperimentsJuan D. Correa, Sanghack Lee, Elias BareinboimNeurIPS 2021 · 被引用 48 次
- Vision-and-Language Navigation via Causal LearningLiuyi Wang, Zongtao He, Ronghao Dang, Mengjiao Shen 等CVPR 2024 · 被引用 24 次
- Deep Learning Methods for Proximal Inference via Maximum Moment RestrictionBenjamin Kompa, David R. Bellamy, Thomas Kolokotrones, James M. Robins 等NeurIPS 2022 · 被引用 22 次
相关 Paper
- Causal Effect Regularization: Automated Detection and Removal of Spurious CorrelationsAbhinav Kumar, Amit Deshpande, Amit SharmaNeurIPS 2023 · 被引用 7 次
- Information-Theoretic Bias Reduction via Causal View of Spurious CorrelationSeonguk Seo, Joon-Young Lee, Bohyung HanAAAI 2022 · 被引用 29 次
- Efficient Conditionally Invariant Representation LearningRoman Pogodin, Namrata Deka, Yazhe Li, Danica J. Sutherland 等ICLR 2023 · 被引用 2 次
- Counterfactual Maximum Likelihood Estimation for Training Deep NetworksXinyi Wang, Wenhu Chen, Michael Saxon, William Yang WangNeurIPS 2021 · 被引用 9 次
- De-biasing Distantly Supervised Named Entity Recognition via Causal InterventionWenkai Zhang, Hongyu Lin, Xianpei Han, Le SunACL 2021
