A Near-Optimal Algorithm for Debiasing Trained Machine Learning Models
Ibrahim M. Alabdulmohsin, Mario Lucic
Abstract
We present a scalable post-processing algorithm for debiasing trained models, including deep neural networks (DNNs), which we prove to be near-optimal by bounding its excess Bayes risk. We empirically validate its advantages on standard benchmark datasets across both classical algorithms as well as modern DNN architectures and demonstrate that it outperforms previous post-processing methods while performing on par with in-processing. In addition, we show that the proposed algorithm is particularly effective for models trained at scale where post-processing is a natural and practical choice.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bf34baa3-2f78-4668-a3e4-e23ccf5fa3c0Cited by top-tier papers10
- Scaling Vision Transformers to 22 Billion ParametersMostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski et al.ICML 2023 · 848 citations
- Diagnosing failures of fairness transfer across distribution shift in real-world medical settingsJessica Schrouff, Natalie Harris, Sanmi Koyejo, Ibrahim M. Alabdulmohsin et al.NeurIPS 2022 · 84 citations
- CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?Ibrahim Alabdulmohsin, Xiao Wang, Andreas Peter Steiner, Priya Goyal et al.ICLR 2024 · 35 citations
- Extremely Simple Activation Shaping for Out-of-Distribution DetectionAndrija Djurisic, Nebojsa Bozanic, Arjun Ashok, Rosanne LiuICLR 2023 · 23 citations
- Are Two Heads the Same as One? Identifying Disparate Treatment in Fair Neural NetworksMichael Lohaus, Matthäus Kleindessner, Krishnaram Kenthapadi, Francesco Locatello et al.NeurIPS 2022 · 15 citations
Builds on2
- On Robustness and Transferability of Convolutional Neural NetworksJosip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders et al.CVPR 2021
- Towards Fairness in Visual Recognition: Effective Strategies for Bias MitigationZeyu Wang, Klint Qinami, Ioannis Christos Karakozis, Kyle Genova et al.CVPR 2020
Related papers
- Mining bias-target Alignment from Voronoi CellsRémi Nahon, Van-Tam Nguyen, Enzo TartaglioneICCV 2023 · 8 citations
- VNN: Verification-Friendly Neural Networks with Hard Robustness GuaranteesAnahita Baninajjar, Ahmed Rezine, Amir AminifarICML 2024 · 2 citations
- Weighted Distillation with Unlabeled ExamplesFotis Iliopoulos, Vasilis Kontonis, Cenk Baykal, Gaurav Menghani et al.NeurIPS 2022 · 20 citations
- Rethinking Calibration of Deep Neural Networks: Do Not Be Afraid of OverconfidenceDeng-Bao Wang, Lei Feng, Min-Ling ZhangNeurIPS 2021 · 177 citations
- Robust And Interpretable Blind Image Denoising Via Bias-Free Convolutional Neural NetworksSreyas Mohan, Zahra Kadkhodaie, Eero P. Simoncelli, Carlos Fernandez-GrandaICLR 2020 · 154 citations
