The Price of Fairness in Active Learning: Fundamental Limits and Optimal Label Acquisition
Chang Lu, Yizheng Zhao
Abstract
When a classifier is trained by actively choosing which examples to label, should its labeling budget depend on which notion of fairness it must satisfy? We answer this with the first information-theoretic lower bounds for group-fair active learning, and the answer is a sharp hierarchy across the three standard notions. Demographic Parity (DP), which equalizes the positive prediction rate across groups, can be verified from unlabeled data alone, so it adds no labels beyond ordinary learning. Equal Opportunity (EO), which equalizes each group's true positive rate, is fundamentally harder: estimating a rate conditioned on the true label forces the learner to collect labeled positives from every group, an irreducible cost that no query strategy can avoid. Equalized Odds (EqOdds), which additionally equalizes false positive rates, costs no more than EO whenever positives are the minority, the typical regime.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 9c88a077-5cce-4ff9-b277-947663f0b51cRelated papers
- FaiREE: fair classification with finite-sample and distribution-free guaranteePuheng Li, James Zou, Linjun ZhangICLR 2023
- Post-hoc bias scoring is optimal for fair classificationWenlong Chen, Yegor Klochkov, Yang LiuICLR 2024 · 12 citations
- Bayes-Optimal Fair Classification with Multiple Sensitive FeaturesYi Yang, Yinghui Huang, Xiangyu ChangAAAI 2026 · 2 citations
- On the Impossibility of Non-trivial Accuracy in Presence of Fairness ConstraintsCarlos Pinzón, Catuscia Palamidessi, Pablo Piantanida, Frank ValenciaAAAI 2022 · 11 citations
- Fair Decisions from Calibrated Scores: Achieving Optimal Classification While Satisfying SufficiencyEtam Benger, Katrina LigettICML 2026
