A Federated Stochastic Multi-level Compositional Minimax Algorithm for Deep AUC Maximization
Xinwen Zhang, Ali Payani, Myungjin Lee, Richard Souvenir, Hongchang Gao
摘要
AUC maximization is an effective approach to address the imbalanced data classification problem in federated learning. In the past few years, a couple of federated AUC maximization approaches have been developed based on the minimax optimization. However, directly solving a minimax optimization problem to maximize the AUC score cannot achieve satisfactory performance. To address this issue, we propose to maximize AUC via optimizing a federated multi-level compositional minimax problem. Specifically, we develop a novel federated multi-level compositional minimax algorithm with rigorous theoretical guarantees to solve this new learning paradigm in both algorithmic design and theoretical analysis. To the best of our knowledge, this is the first work studying the multi-level minimax optimization problem. Additionally, extensive empirical evaluations confirm the efficacy of our proposed approach.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan 等ICLR 2020 · 被引用 1,496 次
- Addressing Class Imbalance in Federated LearningLixu Wang, Shichao Xu, Xiao Wang, Qi ZhuAAAI 2021 · 被引用 314 次
- Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image ClassificationZhuoning Yuan, Yan Yan, Milan Sonka, Tianbao YangICCV 2021 · 被引用 147 次
- Stochastic AUC Maximization with Deep Neural NetworksMingrui Liu, Zhuoning Yuan, Yiming Ying, Tianbao YangICLR 2020 · 被引用 118 次
相关 Paper
- Federated Compositional Deep AUC MaximizationXinwen Zhang, Yihan Zhang, Tianbao Yang, Richard Souvenir 等NeurIPS 2023 · 被引用 17 次
- Compositional Training for End-to-End Deep AUC MaximizationZhuoning Yuan, Zhishuai Guo, Nitesh V. Chawla, Tianbao YangICLR 2022 · 被引用 34 次
- Asynchronous Vertical Federated Learning for Kernelized AUC MaximizationKe Zhang, Ganyu Wang, Han Li, Yulong Wang 等KDD 2024 · 被引用 3 次
- Federated Deep AUC Maximization for Hetergeneous Data with a Constant Communication ComplexityZhuoning Yuan, Zhishuai Guo, Yi Xu, Yiming Ying 等ICML 2021 · 被引用 38 次
- Solving a Class of Non-Convex Minimax Optimization in Federated LearningXidong Wu, Jianhui Sun, Zhengmian Hu, Aidong Zhang 等NeurIPS 2023 · 被引用 26 次
