A Near-Optimal Algorithm for Decentralized Convex-Concave Finite-Sum Minimax Optimization
Hongxu Chen, Ke Wei, Haishan Ye, Luo Luo
Abstract
In this paper, we study the distributed convex-concave finite-sum minimax optimization over the network, and a decentralized variance-reduced optimistic gradient method with stochastic mini-batch sizes (DIVERSE) is proposed. For the stronglyconvex-strongly-concave objective, it is shown that DIVERSE can achieve a linear convergence rate that depends on the global smoothness parameters, yielding sharper computation and communication complexity bounds than existing results. Furthermore, we also establish the lower complexity bounds, which show that our upper bounds are optimal up to a logarithmic factor in terms of the local incremental first-order oracle calls, the computation rounds, and the communication rounds. Numerical experiments demonstrate that our algorithm outperforms existing methods in practice.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d609bd3c-1863-4204-b222-190a1c0bf472Builds on17
- Fast is better than free: Revisiting adversarial trainingEric Wong, Leslie Rice, J. Zico KolterICLR 2020 · 1,352 citations
- Universal Adversarial TrainingAli Shafahi, Mahyar Najibi, Zheng Xu, John P. Dickerson et al.AAAI 2020 · 210 citations
- An Improved Analysis of Gradient Tracking for Decentralized Machine LearningAnastasia Koloskova, Tao Lin, Sebastian U. StichNeurIPS 2021 · 148 citations
- Optimal and Practical Algorithms for Smooth and Strongly Convex Decentralized OptimizationDmitry Kovalev, Adil Salim, Peter RichtárikNeurIPS 2020 · 111 citations
- Improved Algorithms for Convex-Concave Minimax OptimizationYuanhao Wang, Jian LiNeurIPS 2020 · 80 citations
Related papers
- Near-Optimal Distributed Minimax Optimization under the Second-Order SimilarityQihao Zhou, Haishan Ye, Luo LuoNeurIPS 2024 · 2 citations
- Jointly Improving the Sample and Communication Complexities in Decentralized Stochastic Minimax OptimizationXuan Zhang, Gabriel Mancino-Ball, Necdet Serhat Aybat, Yangyang XuAAAI 2024 · 14 citations
- Decentralized Convex Finite-Sum Optimization with Better Dependence on Condition NumbersYuxing Liu, Lesi Chen, Luo LuoICML 2024 · 2 citations
- A Faster Decentralized Algorithm for Nonconvex Minimax ProblemsWenhan Xian, Feihu Huang, Yanfu Zhang, Heng HuangNeurIPS 2021 · 72 citations
- Lower Bounds and Optimal Algorithms for Smooth and Strongly Convex Decentralized Optimization Over Time-Varying NetworksDmitry Kovalev, Elnur Gasanov, Alexander V. Gasnikov, Peter RichtárikNeurIPS 2021 · 55 citations
