Convergence-Driven Federated Learning with Joint Compression and Computation Optimization
Ming Zhan, Kevin S. Chan, Mingyue Ji
摘要
Federated Learning (FL) has emerged as a powerful paradigm for distributed model training that preserves data privacy while aggregating model updates through a central server. However, efficiently implementing federated learning in resource-constrained and heterogeneous edge environments remains challenging due to the trade-off between convergence performance and computation/communication costs. Most of the existing approaches only heuristically tune the compression and computation parameters without directly minimizing the theoretical convergence bound. In this paper, we propose the first FL framework, Convergence-driven Federated learning (ConFed), that explicitly formulates and minimizes the non-convex convergence error upper bound under time-averaged expected resource constraints, providing a principled foundation for joint optimization of computation and compression. ConFed supports diverse compression mechanisms, including Top-k sparsification, random quantization, and their combinations. Extensive experiments on Fashion-MNIST (FMNIST) and CIFAR-10 demonstrate that our method achieves faster convergence and lower resource costs compared to state-of-the-art approaches.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned DataTimothy J. Castiglia, Anirban Das, Shiqiang Wang, Stacy PattersonICML 2022 · 被引用 72 次
- ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive TrainingHui-Po Wang, Sebastian U. Stich, Yang He, Mario FritzICML 2022 · 被引用 70 次
- To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge DevicesLiang Li, Dian Shi, Ronghui Hou, Hui Li 等INFOCOM 2021 · 被引用 196 次
- AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge DevicesPeichun Li, Guoliang Cheng, Xumin Huang, Jiawen Kang 等INFOCOM 2023 · 被引用 32 次
- Federated Learning with Flexible ControlShiqiang Wang, Jake B. Perazzone, Mingyue Ji, Kevin S. ChanINFOCOM 2023 · 被引用 30 次
