A Near-Optimal Algorithm for Decentralized Convex-Concave Finite-Sum Minimax Optimization
Hongxu Chen, Ke Wei, Haishan Ye, Luo Luo
摘要
In this paper, we study the distributed convex-concave finite-sum minimax optimization over the network, and a decentralized variance-reduced optimistic gradient method with stochastic mini-batch sizes (DIVERSE) is proposed. For the stronglyconvex-strongly-concave objective, it is shown that DIVERSE can achieve a linear convergence rate that depends on the global smoothness parameters, yielding sharper computation and communication complexity bounds than existing results. Furthermore, we also establish the lower complexity bounds, which show that our upper bounds are optimal up to a logarithmic factor in terms of the local incremental first-order oracle calls, the computation rounds, and the communication rounds. Numerical experiments demonstrate that our algorithm outperforms existing methods in practice.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Fast is better than free: Revisiting adversarial trainingEric Wong, Leslie Rice, J. Zico KolterICLR 2020 · 被引用 1,352 次
- Universal Adversarial TrainingAli Shafahi, Mahyar Najibi, Zheng Xu, John P. Dickerson 等AAAI 2020 · 被引用 210 次
- An Improved Analysis of Gradient Tracking for Decentralized Machine LearningAnastasia Koloskova, Tao Lin, Sebastian U. StichNeurIPS 2021 · 被引用 148 次
- Optimal and Practical Algorithms for Smooth and Strongly Convex Decentralized OptimizationDmitry Kovalev, Adil Salim, Peter RichtárikNeurIPS 2020 · 被引用 111 次
- Improved Algorithms for Convex-Concave Minimax OptimizationYuanhao Wang, Jian LiNeurIPS 2020 · 被引用 80 次
相关 Paper
- Near-Optimal Distributed Minimax Optimization under the Second-Order SimilarityQihao Zhou, Haishan Ye, Luo LuoNeurIPS 2024 · 被引用 2 次
- Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax OptimizationXuan Zhang, Gabriel Mancino-Ball, Necdet Serhat Aybat, Yangyang XuAAAI 2024 · 被引用 14 次
- Decentralized Convex Finite-Sum Optimization with Better Dependence on Condition NumbersYuxing Liu, Lesi Chen, Luo LuoICML 2024 · 被引用 2 次
- A Faster Decentralized Algorithm for Nonconvex Minimax ProblemsWenhan Xian, Feihu Huang, Yanfu Zhang, Heng HuangNeurIPS 2021 · 被引用 72 次
- Lower Bounds and Optimal Algorithms for Smooth and Strongly Convex Decentralized Optimization Over Time-Varying NetworksDmitry Kovalev, Elnur Gasanov, Alexander V. Gasnikov, Peter RichtárikNeurIPS 2021 · 被引用 55 次
