Federated Active Learning Under Extreme Non-IID and Global Class Imbalance
Chen-Chen Zong, Sheng-Jun Huang
摘要
Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its effectiveness degrades in realistic settings with severe global class imbalance and highly heterogeneous clients. We conduct a systematic study of query-model selection in FAL and uncover a central insight: the model that achieves more class-balanced sampling, especially for minority classes, consistently leads to better final performance. Moreover, global-model querying is beneficial only when the global distribution is highly imbalanced and client data are relatively homogeneous; otherwise, the local model is preferable. Based on these findings, we propose FairFAL, an adaptive class-fair FAL framework. FairFAL (1) infers global imbalance and local-global divergence via lightweight prediction discrepancy, enabling adaptive selection between global and local query models; (2) performs prototype-guided pseudo-labeling using global features to promote class-aware querying; and (3) applies a two-stage uncertainty-diversity balanced sampling strategy with k-center refinement. Experiments on five benchmarks show that FairFAL consistently outperforms state-of-the-art approaches under challenging long-tailed and non-IID settings. The code is available at https://github.com/chenchenzong/FairFAL.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper23
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower BoundsJordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford 等ICLR 2020 · 被引用 974 次
- Federated Multi-Task Learning under a Mixture of DistributionsOthmane Marfoq, Giovanni Neglia, Aurélien Bellet, Laetitia Kameni 等NeurIPS 2021 · 被引用 415 次
- Federated Continual Learning with Weighted Inter-client TransferJaehong Yoon, Wonyong Jeong, Giwoong Lee, Eunho Yang 等ICML 2021 · 被引用 303 次
- Active Domain Adaptation via Clustering Uncertainty-weighted EmbeddingsViraj Prabhu, Arjun Chandrasekaran, Kate Saenko, Judy HoffmanICCV 2021 · 被引用 160 次
相关 Paper
- Knowledge-Aware Federated Active Learning with Non-IID DataYu-Tong Cao, Ye Shi, Baosheng Yu, Jingya Wang 等ICCV 2023 · 被引用 30 次
- Re-Thinking Federated Active Learning Based on Inter-Class DiversitySangmook Kim, Sangmin Bae, Hwanjun Song, Se-Young YunCVPR 2023
- FedReLa: Imbalanced Federated Learning via Re-LabelingGuangzheng Hu, Patricia Menendez Galvan, Feng Liu, Mingming Gong 等ICML 2026
- Class-Aware Active Annotation in Federated Semi-Supervised Learning for Medical Image ClassificationMeiting Xue, Miaoqi Li, Yukun Shi, Yan Zeng 等AAAI 2026
- Think Twice Before Selection: Federated Evidential Active Learning for Medical Image Analysis with Domain ShiftsJiayi Chen, Benteng Ma, Hengfei Cui, Yong XiaCVPR 2024
