Convergence-Driven Federated Learning with Joint Compression and Computation Optimization
Ming Zhan, Kevin S. Chan, Mingyue Ji
Abstract
Federated Learning (FL) has emerged as a powerful paradigm for distributed model training that preserves data privacy while aggregating model updates through a central server. However, efficiently implementing federated learning in resource-constrained and heterogeneous edge environments remains challenging due to the trade-off between convergence performance and computation/communication costs. Most of the existing approaches only heuristically tune the compression and computation parameters without directly minimizing the theoretical convergence bound. In this paper, we propose the first FL framework, Convergence-driven Federated learning (ConFed), that explicitly formulates and minimizes the non-convex convergence error upper bound under time-averaged expected resource constraints, providing a principled foundation for joint optimization of computation and compression. ConFed supports diverse compression mechanisms, including Top-k sparsification, random quantization, and their combinations. Extensive experiments on Fashion-MNIST (FMNIST) and CIFAR-10 demonstrate that our method achieves faster convergence and lower resource costs compared to state-of-the-art approaches.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get cc751082-5469-4fd4-a35e-28fa3dc8643aRelated papers
- Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned DataTimothy J. Castiglia, Anirban Das, Shiqiang Wang, Stacy PattersonICML 2022 · 72 citations
- ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive TrainingHui-Po Wang, Sebastian U. Stich, Yang He, Mario FritzICML 2022 · 70 citations
- To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge DevicesLiang Li, Dian Shi, Ronghui Hou, Hui Li et al.INFOCOM 2021 · 196 citations
- AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge DevicesPeichun Li, Guoliang Cheng, Xumin Huang, Jiawen Kang et al.INFOCOM 2023 · 32 citations
- Federated Learning with Flexible ControlShiqiang Wang, Jake B. Perazzone, Mingyue Ji, Kevin S. ChanINFOCOM 2023 · 30 citations
