Decoupled SGDA for Games with Intermittent Strategy Communication
Ali Zindari, Parham Yazdkhasti, Anton Rodomanov, Tatjana Chavdarova, Sebastian U. Stich
摘要
We introduce Decoupled SGDA, a novel adaptation of Stochastic Gradient Descent Ascent (SGDA) tailored for multiplayer games with intermittent strategy communication. Unlike prior methods, Decoupled SGDA enables players to update strategies locally using outdated opponent strategies, significantly reducing communication overhead. For Strongly-Convex-Strongly-Concave (SCSC) games, it achieves near-optimal communication complexity comparable to the best-known GDA rates. For weakly coupled games where the interaction between players is lower relative to the non-interactive part of the game, Decoupled SGDA significantly reduces communication costs compared to standard SGDA. Additionally, Decoupled SGDA outperforms federated minimax approaches in noisy, imbalanced settings. These results establish Decoupled SGDA as a transformative approach for distributed optimization in resource-constrained environments.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesAnastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi 等ICML 2020 · 被引用 623 次
- Decentralized Q-learning in Zero-sum Markov GamesMuhammed O. Sayin, Kaiqing Zhang, David S. Leslie, Tamer Basar 等NeurIPS 2021 · 被引用 105 次
- Federated Minimax Optimization: Improved Convergence Analyses and AlgorithmsPranay Sharma, Rohan Panda, Gauri Joshi, Pramod K. VarshneyICML 2022 · 被引用 63 次
- Linear Lower Bounds and Conditioning of Differentiable GamesAdam Ibrahim, Waïss Azizian, Gauthier Gidel, Ioannis MitliagkasICML 2020 · 被引用 52 次
相关 Paper
- SAGDA: Achieving Communication Complexity in Federated Min-Max LearningHaibo Yang, Zhuqing Liu, Xin Zhang, Jia LiuNeurIPS 2022
- A Communication-efficient Algorithm with Linear Convergence for Federated Minimax LearningZhenyu Sun, Ermin WeiNeurIPS 2022 · 被引用 20 次
- Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax OptimizationXuan Zhang, Gabriel Mancino-Ball, Necdet Serhat Aybat, Yangyang XuAAAI 2024 · 被引用 14 次
- Minibatch vs Local SGD for Heterogeneous Distributed LearningBlake E. Woodworth, Kumar Kshitij Patel, Nati SrebroNeurIPS 2020 · 被引用 231 次
- Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent AlgorithmMiaoxi Zhu, Li Shen, Bo Du, Dacheng TaoNeurIPS 2023 · 被引用 12 次
