FR-Train: A Mutual Information-Based Approach to Fair and Robust Training
Yuji Roh, Kangwook Lee, Steven Whang, Changho Suh
Abstract
Trustworthy AI is a critical issue in machine learning where, in addition to training a model that is accurate, one must consider both fair and robust training in the presence of data bias and poisoning. However, the existing model fairness techniques mistakenly view poisoned data as an additional bias to be fixed, resulting in severe performance degradation. To address this problem, we propose FR-Train, which holistically performs fair and robust model training. We provide a mutual information-based interpretation of an existing adversarial training-based fairness-only method, and apply this idea to architect an additional discriminator that can identify poisoned data using a clean validation set and reduce its influence. In our experiments, FR-Train shows almost no decrease in fairness and accuracy in the presence of data poisoning by both mitigating the bias and defending against poisoning. We also demonstrate how to construct clean validation sets using crowdsourcing, and release new benchmark datasets 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers26
- FairBatch: Batch Selection for Model FairnessYuji Roh, Kangwook Lee, Steven Euijong Whang, Changho SuhICLR 2021 · 156 citations
- A Fair Classifier Using Kernel Density EstimationJaewoong Cho, Gyeongjo Hwang, Changho SuhNeurIPS 2020 · 85 citations
- Sample Selection for Fair and Robust TrainingYuji Roh, Kangwook Lee, Steven Whang, Changho SuhNeurIPS 2021 · 76 citations
- Generalized Demographic Parity for Group FairnessZhimeng Jiang, Xiaotian Han, Chao Fan, Fan Yang et al.ICLR 2022 · 71 citations
- Fairness without Demographics through Knowledge DistillationJunyi Chai, Taeuk Jang, Xiaoqian WangNeurIPS 2022 · 57 citations
Related papers
- FedVal: Different good or different bad in federated learningViktor Valadi, Xinchi Qiu, Pedro Porto Buarque de Gusmão, Nicholas D. Lane et al.USENIX Security 2023
- Towards Poisoning Fair RepresentationsTianci Liu, Haoyu Wang, Feijie Wu, Hengtong Zhang et al.ICLR 2024 · 3 citations
- To be Robust or to be Fair: Towards Fairness in Adversarial TrainingHan Xu, Xiaorui Liu, Yaxin Li, Anil K. Jain et al.ICML 2021 · 218 citations
- On the Alignment between Fairness and Accuracy: from the Perspective of Adversarial RobustnessJunyi Chai, Taeuk Jang, Jing Gao, Xiaoqian WangICML 2025
- Fight Fire with Fire: Towards Robust Recommender Systems via Adversarial Poisoning TrainingChenwang Wu, Defu Lian, Yong Ge, Zhihao Zhu et al.SIGIR 2021 · 47 citations
