Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization
Difei Xu, Youming Tao, Meng Ding, Chenglin Fan, Di Wang
摘要
We provide the first study of the problem of finding differentially private (DP) second-order stationary points (SOSP) in stochastic (non-convex) minimax optimization. Existing literature either focuses only on first-order stationary points for minimax problems or on SOSP for classical stochastic minimization problems. This work provides, for the first time, a unified and detailed treatment of both empirical and population risks. Specifically, we propose a purely first-order method that combines a nested gradient descent--ascent scheme with SPIDER-style variance reduction and Gaussian perturbations to ensure privacy. A key technical device is a block-wise (-period) analysis that controls the accumulation of stochastic variance and privacy noise without summing over the full iteration horizon, yielding a unified treatment of both empirical-risk and population formulations. Under standard smoothness, Hessian-Lipschitzness, and strong concavity assumptions, we establish high-probability guarantees for reaching an -approximate second-order stationary point with for empirical risk objectives and for population objectives, matching the best known rates for private first-order stationarity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization?Chi Jin, Praneeth Netrapalli, Michael I. JordanICML 2020 · 被引用 381 次
- Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax ProblemsLuo Luo, Haishan Ye, Zhichao Huang, Tong ZhangNeurIPS 2020 · 被引用 152 次
- Faster Rates of Convergence to Stationary Points in Differentially Private OptimizationRaman Arora, Raef Bassily, Tomás González, Cristóbal Guzmán 等ICML 2023 · 被引用 37 次
- Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax OptimizationLiang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao HeNeurIPS 2022 · 被引用 25 次
- Finding Second-Order Stationary Points in Nonconvex-Strongly-Concave Minimax OptimizationLuo Luo, Yujun Li, Cheng ChenNeurIPS 2022 · 被引用 22 次
相关 Paper
- Second-Order Convergence in Private Stochastic Non-Convex OptimizationYouming Tao, Zuyuan Zhang, Dongxiao Yu, Xiuzhen Cheng 等NeurIPS 2025 · 被引用 4 次
- Improved Rates of Differentially Private Nonconvex-Strongly-Concave Minimax OptimizationRuijia Zhang, Mingxi Lei, Meng Ding, Zihang Xiang 等AAAI 2025 · 被引用 7 次
- Adaptive Batch Size for Privately Finding Second-Order Stationary PointsDaogao Liu, Kunal TalwarICLR 2025
- Momentum Aggregation for Private Non-convex ERMHoang Tran, Ashok CutkoskyNeurIPS 2022 · 被引用 14 次
- Private Zeroth-Order Nonsmooth Nonconvex OptimizationQinzi Zhang, Hoang Tran, Ashok CutkoskyICLR 2024 · 被引用 9 次
