Resilient Federated Learning on Embedded Devices with Constrained Network Connectivity
Zihan Li, Han Liu, Ao Li, Ching-Hsiang Chan, Yevgeniy Vorobeychik, William Yeoh, Wenjing Lou, Ning Zhang
Abstract
Federated learning enables decentralized model training while preserving data privacy. However, since the learning process overlays the physical network infrastructure, the efficiency of learning can be impacted by network connectivity. In this work, we conducted extensive experiments to empirically characterize the impacts and leverage the insights to propose an adaptive federation framework, where clients with limited bandwidth are only prompted to transmit adaptively compressed gradient updates when the gradient similarity score is similar between the local and global models. Our evaluation in simulated environments and on real hardware devices shows bandwidth savings of 60% to 78% compared to state-of-the-art methods.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Network Adaptive Federated Learning: Congestion and Lossy CompressionParikshit Hegde, Gustavo de Veciana, Aryan MokhtariINFOCOM 2023 · 10 citations
- Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient CompressionZhida Jiang, Yang Xu, Hongli Xu, Zhiyuan Wang et al.INFOCOM 2023 · 43 citations
- Communication-Efficient Federated Learning for Heterogeneous Edge Devices Based on Adaptive Gradient QuantizationHeting Liu, Fang He, Guohong CaoINFOCOM 2023 · 60 citations
- Optimal Rate Adaption in Federated Learning with Compressed CommunicationsLaizhong Cui, Xiaoxin Su, Yipeng Zhou, Jiangchuan LiuINFOCOM 2022 · 61 citations
- AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge DevicesPeichun Li, Guoliang Cheng, Xumin Huang, Jiawen Kang et al.INFOCOM 2023 · 32 citations
