Federated Learning with Positive and Unlabeled Data
Xinyang Lin, Hanting Chen, Yixing Xu, Chao Xu, Xiaolin Gui, Yiping Deng, Yunhe Wang
Abstract
We study the problem of learning from positive and unlabeled (PU) data in the federated setting, where each client only labels a little part of their dataset due to the limitation of resources and time. Different from the settings in traditional PU learning where the negative class consists of a single class, the negative samples which cannot be identified by a client in the federated setting may come from multiple classes which are unknown to the client. Therefore, existing PU learning methods can be hardly applied in this situation. To address this problem, we propose a novel framework, namely Federated learning with Positive and Unlabeled data (FedPU), to minimize the expected risk of multiple negative classes by leveraging the labeled data in other clients. We theoretically analyze the generalization bound of the proposed FedPU. Empirical experiments show that the FedPU can achieve much better performance than conventional supervised and semi-supervised federated learning methods. Code is available at https://github.com/ littleSunlxy/FedPU-torch
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 28818374-18e3-473d-a9bb-2ced4d8a5633Cited by top-tier papers3
- Local or Global: Selective Knowledge Assimilation for Federated Learning with Limited LabelsYae Jee Cho, Gauri Joshi, Dimitrios DimitriadisICCV 2023 · 11 citations
- Navigating Alignment for Non-identical Client Class Sets: A Label Name-Anchored Federated Learning FrameworkJiayun Zhang, Xiyuan Zhang, Xinyang Zhang, Dezhi Hong et al.KDD 2023 · 8 citations
- Regression with Sensor Data Containing Incomplete ObservationsTakayuki Katsuki, Takayuki OsogamiICML 2023 · 1 citation
Builds on9
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Practical Secure Aggregation for Privacy-Preserving Machine LearningKallista A. Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone et al.CCS 2017 · 3,936 citations
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- An Efficient Framework for Clustered Federated LearningAvishek Ghosh, Jichan Chung, Dong Yin, Kannan RamchandranNeurIPS 2020 · 1,329 citations
Related papers
- Balancing Positive and Negative Classification Error Rates in Positive-Unlabeled LearningXiming Li, Yuanchao Dai, Bing Wang, Changchun Li et al.NeurIPS 2025 · 3 citations
- Federated Learning from Only Unlabeled Data with Class-conditional-sharing ClientsNan Lu, Zhao Wang, Xiaoxiao Li, Gang Niu et al.ICLR 2022 · 44 citations
- Learning from positive and unlabeled examples -Finite size sample boundsFarnam Mansouri, Shai Ben-DavidNeurIPS 2025 · 6 citations
- Dist-PU: Positive-Unlabeled Learning from a Label Distribution PerspectiveYunrui Zhao, Qianqian Xu, Yangbangyan Jiang, Peisong Wen et al.CVPR 2022 · 47 citations
- GradPU: Positive-Unlabeled Learning via Gradient Penalty and Positive UpweightingSongmin Dai, Xiaoqiang Li, Yue Zhou, Xichen Ye et al.AAAI 2023 · 9 citations
