ProtoFL: Unsupervised Federated Learning via Prototypical Distillation
Hansol Kim, Youngjun Kwak, Minyoung Jung, Jinho Shin, Youngsung Kim, Changick Kim
Abstract
Federated learning (FL) is a promising approach for enhancing data privacy preservation, particularly for authentication systems. However, limited round communications, scarce representation, and scalability pose significant challenges to its deployment, hindering its full potential. In this paper, we propose ‘ProtoFL’, Prototypical Representation Distillation based unsupervised Federated Learning to enhance the representation power of a global model and reduce round communication costs. Additionally, we introduce a local one-class classifier based on normalizing flows to improve performance with limited data. Our study represents the first investigation of using FL to improve one-class classification performance. We conduct extensive experiments on five widely used benchmarks, namely MNIST, CIFAR-10, CIFAR-100, ImageNet-30, and Keystroke-Dynamics, to demonstrate the superior performance of our proposed framework over previous methods in the literature.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c679eef4-1c37-4bf2-aecd-92cef40995b4Cited by top-tier papers5
- FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model FusionZhenheng Tang, Yonggang Zhang, Peijie Dong, Yiu-ming Cheung et al.NeurIPS 2024 · 28 citations
- Cooperative Pseudo Labeling for Unsupervised Federated ClassificationKuangpu Guo, Lijun Sheng, Yongcan Yu, Jian Liang et al.ICCV 2025 · 1 citation
- HiLoRA: Hierarchical Low-Rank Adaptation for Personalized Federated LearningZihao Peng, Nan Zou, Jiandian Zeng, Guo Li et al.CVPR 2026 · 1 citation
- Towards Privacy-preserved Pre-training of Remote Sensing Foundation Models with Federated Mutual-Guidance LearningJieyi Tan, Chengwei Zhang, Bo Dang, Yansheng LiICCV 2025 · 1 citation
- Rethinking the Representation in Federated Unsupervised Learning with Non-IID DataXinting Liao, Weiming Liu, Chaochao Chen, Pengyang Zhou et al.CVPR 2024
Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- On the Variance of the Adaptive Learning Rate and BeyondLiyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen et al.ICLR 2020 · 2,210 citations
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 1,081 citations
- CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted InstancesJihoon Tack, Sangwoo Mo, Jongheon Jeong, Jinwoo ShinNeurIPS 2020 · 755 citations
- Deep Semi-Supervised Anomaly DetectionLukas Ruff, Robert A. Vandermeulen, Nico Görnitz, Alexander Binder et al.ICLR 2020 · 678 citations
Related papers
- Class-Wise Federated Averaging for Efficient PersonalizationGyuejeong Lee, Daeyoung ChoiICCV 2025 · 3 citations
- FedHPro: Federated Hyper-Prototype Learning via Gradient MatchingHuan Wang, Jun Shen, Haoran Li, Zhenyu Yang et al.ICML 2026
- Federated Learning with Label-Masking DistillationJianghu Lu, Shikun Li, Kexin Bao, Pengju Wang et al.ACM MM 2023 · 24 citations
- FedRE: A Representation Entanglement Framework for Model-Heterogeneous Federated LearningYuan Yao, Lixu Wang, Jiaqi Wu, Jin Song et al.CVPR 2026 · 3 citations
- Rethinking Federated Learning with Domain Shift: A Prototype ViewWenke Huang, Mang Ye, Zekun Shi, He Li et al.CVPR 2023
