A Federated Stochastic Multi-level Compositional Minimax Algorithm for Deep AUC Maximization
Xinwen Zhang, Ali Payani, Myungjin Lee, Richard Souvenir, Hongchang Gao
Abstract
AUC maximization is an effective approach to address the imbalanced data classification problem in federated learning. In the past few years, a couple of federated AUC maximization approaches have been developed based on the minimax optimization. However, directly solving a minimax optimization problem to maximize the AUC score cannot achieve satisfactory performance. To address this issue, we propose to maximize AUC via optimizing a federated multi-level compositional minimax problem. Specifically, we develop a novel federated multi-level compositional minimax algorithm with rigorous theoretical guarantees to solve this new learning paradigm in both algorithmic design and theoretical analysis. To the best of our knowledge, this is the first work studying the multi-level minimax optimization problem. Additionally, extensive empirical evaluations confirm the efficacy of our proposed approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7a63d13b-4a2e-402c-8fbb-3146ffafb8c2Builds on17
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Addressing Class Imbalance in Federated LearningLixu Wang, Shichao Xu, Xiao Wang, Qi ZhuAAAI 2021 · 314 citations
- Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image ClassificationZhuoning Yuan, Yan Yan, Milan Sonka, Tianbao YangICCV 2021 · 147 citations
- Stochastic AUC Maximization with Deep Neural NetworksMingrui Liu, Zhuoning Yuan, Yiming Ying, Tianbao YangICLR 2020 · 118 citations
Related papers
- Federated Compositional Deep AUC MaximizationXinwen Zhang, Yihan Zhang, Tianbao Yang, Richard Souvenir et al.NeurIPS 2023 · 17 citations
- Compositional Training for End-to-End Deep AUC MaximizationZhuoning Yuan, Zhishuai Guo, Nitesh V. Chawla, Tianbao YangICLR 2022 · 34 citations
- Asynchronous Vertical Federated Learning for Kernelized AUC MaximizationKe Zhang, Ganyu Wang, Han Li, Yulong Wang et al.KDD 2024 · 3 citations
- Federated Deep AUC Maximization for Hetergeneous Data with a Constant Communication ComplexityZhuoning Yuan, Zhishuai Guo, Yi Xu, Yiming Ying et al.ICML 2021 · 38 citations
- Solving a Class of Non-Convex Minimax Optimization in Federated LearningXidong Wu, Jianhui Sun, Zhengmian Hu, Aidong Zhang et al.NeurIPS 2023 · 26 citations
