Metric-Fair Active Learning
Jie Shen, Nan Cui, Jing Wang
Abstract
Active learning has become a prevalent technique for designing label-efficient algorithms, where the central principle is to only query and fit "informative" labeled instances. It is, however, known that an active learning algorithm may incur unfairness due to such instance selection procedure. In this paper, we henceforth study metric-fair active learning of homogeneous halfspaces, and show that under the distribution-dependent PAC learning model, fairness and label efficiency can be achieved simultaneously. We further propose two extensions of our main results: 1) we show that it is possible to make the algorithm robust to the adversarial noise -one of the most challenging noise models in learning theory; and 2) it is possible to significantly improve the label complexity when the underlying halfspace is sparse.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d7303c2c-649e-4bef-acae-8443394cc476Cited by top-tier papers1
Ask how each one uses itBuilds on4
- Retiring Adult: New Datasets for Fair Machine LearningFrances Ding, Moritz Hardt, John Miller, Ludwig SchmidtNeurIPS 2021 · 671 citations
- Efficient active learning of sparse halfspaces with arbitrary bounded noiseChicheng Zhang, Jie Shen, Pranjal AwasthiNeurIPS 2020 · 50 citations
- On the Power of Localized Perceptron for Label-Optimal Learning of Halfspaces with Adversarial NoiseJie ShenICML 2021 · 15 citations
- Sample-Optimal PAC Learning of Halfspaces with Malicious NoiseJie ShenICML 2021 · 14 citations
Related papers
- Efficiently Learning Adversarially Robust Halfspaces with NoiseOmar Montasser, Surbhi Goel, Ilias Diakonikolas, Nathan SrebroICML 2020 · 33 citations
- Active Classification with Few Queries under MisspecificationVasilis Kontonis, Mingchen Ma, Christos TzamosNeurIPS 2024 · 3 citations
- The Complexity of Adversarially Robust Proper Learning of Halfspaces with Agnostic NoiseIlias Diakonikolas, Daniel M. Kane, Pasin ManurangsiNeurIPS 2020 · 23 citations
- Active Learning of General Halfspaces: Label Queries vs Membership QueriesIlias Diakonikolas, Daniel M. Kane, Mingchen MaNeurIPS 2024 · 7 citations
- Efficient Active Learning with AbstentionYinglun Zhu, Robert NowakNeurIPS 2022 · 27 citations
