Fair and Accurate Decision Making through Group-Aware Learning
Ramtin Hosseini, Li Zhang, Bhanu Garg, Pengtao Xie
Abstract
The integration of machine learning models in various real-world applications is becoming more prevalent to assist humans in their daily decisionmaking tasks as a result of recent advancements in this field. However, it has been discovered that there is a tradeoff between the accuracy and fairness of these decision-making tasks. In some cases, these AI systems can be unfair by exhibiting bias or discrimination against certain social groups, which can have severe consequences in real life. Inspired by one of the most well-known human learning skills called grouping, we address this issue by proposing a novel machine learning (ML) framework where the ML model learns to group a diverse set of problems into distinct subgroups to solve each subgroup using its specific sub-model. Our proposed framework involves three stages of learning, which are formulated as a three-level optimization problem: 1) grouping problems into subgroups, 2) learning groupspecific sub-models for problem-solving, and 3) updating group assignments of training examples by minimizing validation loss. These three learning stages are performed end-to-end in a joint manner using gradient descent. To improve fairness and accuracy, we develop an efficient optimization algorithm to solve this three-level optimization problem. To further decrease the risk of overfitting in small datasets using our LBG method, we incorporate domain adaptation techniques in the second stage of training. We further apply our method to differentiable neural architecture search (NAS) methods. The LBG implementation can be found in the Skillearn repository at here.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e57116ff-d263-423a-bd25-458884d7078fCited by top-tier papers1
Ask how each one uses itBuilds on12
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetLi Yuan, Yunpeng Chen, Tao Wang, Weihao Yu et al.ICCV 2021 · 2,462 citations
- Scaling Vision with Sparse Mixture of ExpertsCarlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann et al.NeurIPS 2021 · 1,213 citations
- Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and EvaluationXin Chen, Lingxi Xie, Jun Wu, Qi TianICCV 2019 · 725 citations
- PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture SearchYuhui Xu, Lingxi Xie, Xiaopeng Zhang, Xin Chen et al.ICLR 2020 · 691 citations
Related papers
- Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg EquilibriumMehdi Yazdani-Jahromi, Ali Khodabandeh Yalabadi, Amirarsalan Rajabi, Aida Tayebi et al.NeurIPS 2024 · 11 citations
- Fairness-Aware Meta-Learning via Nash BargainingYi Zeng, Xuelin Yang, Li Chen, Cristian Canton Ferrer et al.NeurIPS 2024 · 10 citations
- Towards an Optimized GROUP BY Abstraction for Large-Scale Machine LearningSide Li, Arun KumarVLDB 2021 · 7 citations
- FairFed: Enabling Group Fairness in Federated LearningYahya H. Ezzeldin, Shen Yan, Chaoyang He, Emilio Ferrara et al.AAAI 2023 · 310 citations
- Synthesizing Fair Decision Trees via Iterative Constraint SolvingJingbo Wang, Yannan Li, Chao WangCAV 2022 · 11 citations
