FedTMOS: Efficient One-Shot Federated Learning with Tsetlin Machine
Shannon How Shi Qi, Jagmohan Chauhan, Geoff V. Merrett, Jonathon S. Hare
Abstract
One-Shot Federated Learning (OFL) is a promising approach that reduce communication to a single round, minimizing latency and resource consumption. However, existing OFL methods often rely on Knowledge Distillation, which introduce server-side training, increasing latency. While neuron matching and model fusion techniques bypass server-side training, they struggle with alignment when heterogeneous data is present. To address these challenges, we proposed One-Shot Federated Learning with Tsetlin Machine (FedTMOS), a novel data-free OFL framework built upon the low-complexity and class-adaptive properties of the Tsetlin Machine. FedTMOS first clusters then reassigns class-specific weights to form models using an inter-class maximization approach, efficiently generating balanced server models without requiring additional training. Our extensive experiments demonstrate that FedTMOS significantly outperforms its ensemble counterpart by an average of %, and the leading state-of-the-art OFL baselines by % across various OFL settings. Moreover, FedTMOS achieves at least a reduction in upload communication costs and a reduction in server latency compared to methods requiring server-side training. These results establish FedTMOS as a highly efficient and practical solution for OFL scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 913c4b22-5a9e-4e3a-a90d-02a71d0b657fCited by top-tier papers2
- You Only Communicate Once: One-shot Federated Low-Rank Adaptation of MLLMBinqian Xu, Haiyang Mei, Zechen Bai, Jinjin Gong et al.NeurIPS 2025 · 4 citations
- Convergence Analysis of Tsetlin Machines under Noise-Free and Noisy Training Conditions: From 2 Bits to k BitsXuan Zhang, Lei Jiao, Ole-Christoffer GranmoICLR 2026
Builds on1
Related papers
- Revisiting Ensembling in One-Shot Federated LearningYoussef Allouah, Akash Balasaheb Dhasade, Rachid Guerraoui, Nirupam Gupta et al.NeurIPS 2024 · 21 citations
- A Unified Solution to Diverse Heterogeneities in One-Shot Federated LearningJun Bai, Yiliao Song, Di Wu, Atul Sajjanhar et al.KDD 2025
- One-shot Federated Learning via Synthetic Distiller-Distillate CommunicationJunyuan Zhang, Songhua Liu, Xinchao WangNeurIPS 2024 · 21 citations
- DENSE: Data-Free One-Shot Federated LearningJie Zhang, Chen Chen, Bo Li, Lingjuan Lyu et al.NeurIPS 2022 · 202 citations
- FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained ClientsDezhong Yao, Tongtong Liu, Yuexin Shi, Zhiqiang XuWWW 2026
