Federated Active Learning Under Extreme Non-IID and Global Class Imbalance
Chen-Chen Zong, Sheng-Jun Huang
Abstract
Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its effectiveness degrades in realistic settings with severe global class imbalance and highly heterogeneous clients. We conduct a systematic study of query-model selection in FAL and uncover a central insight: the model that achieves more class-balanced sampling, especially for minority classes, consistently leads to better final performance. Moreover, global-model querying is beneficial only when the global distribution is highly imbalanced and client data are relatively homogeneous; otherwise, the local model is preferable. Based on these findings, we propose FairFAL, an adaptive class-fair FAL framework. FairFAL (1) infers global imbalance and local-global divergence via lightweight prediction discrepancy, enabling adaptive selection between global and local query models; (2) performs prototype-guided pseudo-labeling using global features to promote class-aware querying; and (3) applies a two-stage uncertainty-diversity balanced sampling strategy with k-center refinement. Experiments on five benchmarks show that FairFAL consistently outperforms state-of-the-art approaches under challenging long-tailed and non-IID settings. The code is available at https://github.com/chenchenzong/FairFAL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on23
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower BoundsJordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford et al.ICLR 2020 · 974 citations
- Federated Multi-Task Learning under a Mixture of DistributionsOthmane Marfoq, Giovanni Neglia, Aurélien Bellet, Laetitia Kameni et al.NeurIPS 2021 · 415 citations
- Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee, Eunho Yang et al.ICML 2021 · 303 citations
- Active Domain Adaptation via Clustering Uncertainty-weighted EmbeddingsViraj Prabhu, Arjun Chandrasekaran, Kate Saenko, Judy HoffmanICCV 2021 · 160 citations
Related papers
- Knowledge-Aware Federated Active Learning with Non-IID DataYu-Tong Cao, Ye Shi, Baosheng Yu, Jingya Wang et al.ICCV 2023 · 30 citations
- Re-Thinking Federated Active Learning Based on Inter-Class DiversitySangmook Kim, Sangmin Bae, Hwanjun Song, Se-Young YunCVPR 2023
- FedReLa: Imbalanced Federated Learning via Re-LabelingGuangzheng Hu, Patricia Menendez Galvan, Feng Liu, Mingming Gong et al.ICML 2026
- Class-Aware Active Annotation in Federated Semi-Supervised Learning for Medical Image ClassificationMeiting Xue, Miaoqi Li, Yukun Shi, Yan Zeng et al.AAAI 2026
- Think Twice Before Selection: Federated Evidential Active Learning for Medical Image Analysis with Domain ShiftsJiayi Chen, Benteng Ma, Hengfei Cui, Yong XiaCVPR 2024
