FedOpenMatch: Towards Semi-Supervised Federated Learning in Open-Set Environments
Hongquan Liu, ChenyuGuo Guo, Yixin Ren, Jihong Guan, Shuigeng Zhou
Abstract
Semi-supervised federated learning (SSFL) has emerged as an effective approach to leverage unlabeled data distributed across multiple data owners for improving model generalization. Existing SSFL methods typically assume that labeled and unlabeled data share the same label space. However, in realistic federated scenarios, unlabeled data often contain categories absent from the labeled set, i.e., outliers, which can severely degrade the performance of SSFL algorithms. In this paper, we address this under-explored issue, formally propose the open-set semi-supervised federated learning (OSSFL) problem, and develop the first OSSFL framework, FedOpenMatch. Our method adopts a one-vs-all (OVA) classifier as the outlier detector, equipped with logit adjustment to mitigate inlier-outlier imbalance and a gradient stop mechanism to reduce feature interference between the OVA and inlier classifiers. In addition, we introduce the logit consistency regularization loss, yielding more robust performance. Extensive experiments on standard benchmarks across diverse data settings demonstrate the effectiveness of FedOpenMatch, which significantly outperforms the baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a92b5e8b-9050-441c-b147-eca3b305d0deBuilds on31
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo LabelingBowen Zhang, Yidong Wang, Wenxin Hou, Hao Wu et al.NeurIPS 2021 · 1,389 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
Related papers
- OpenMatch: Open-Set Semi-supervised Learning with Open-set Consistency RegularizationKuniaki Saito, Donghyun Kim, Kate SaenkoNeurIPS 2021 · 80 citations
- IOMatch: Simplifying Open-Set Semi-Supervised Learning with Joint Inliers and Outliers UtilizationZekun Li, Lei Qi, Yinghuan Shi, Yang GaoICCV 2023 · 47 citations
- Binary Decomposition: A Problem Transformation Perspective for Open-Set Semi-Supervised LearningJun-Yi Hang, Min-Ling ZhangICML 2024 · 4 citations
- SSB: Simple but Strong Baseline for Boosting Performance of Open-Set Semi-Supervised LearningYue Fan, Anna Kukleva, Dengxin Dai, Bernt SchieleICCV 2023 · 15 citations
- Federated Semi-Supervised Learning with Inter-Client Consistency & Disjoint LearningWonyong Jeong, Jaehong Yoon, Eunho Yang, Sung Ju HwangICLR 2021 · 271 citations
