Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization
Difei Xu, Youming Tao, Meng Ding, Chenglin Fan, Di Wang
Abstract
We provide the first study of the problem of finding differentially private (DP) second-order stationary points (SOSP) in stochastic (non-convex) minimax optimization. Existing literature either focuses only on first-order stationary points for minimax problems or on SOSP for classical stochastic minimization problems. This work provides, for the first time, a unified and detailed treatment of both empirical and population risks. Specifically, we propose a purely first-order method that combines a nested gradient descent--ascent scheme with SPIDER-style variance reduction and Gaussian perturbations to ensure privacy. A key technical device is a block-wise (-period) analysis that controls the accumulation of stochastic variance and privacy noise without summing over the full iteration horizon, yielding a unified treatment of both empirical-risk and population formulations. Under standard smoothness, Hessian-Lipschitzness, and strong concavity assumptions, we establish high-probability guarantees for reaching an -approximate second-order stationary point with for empirical risk objectives and for population objectives, matching the best known rates for private first-order stationarity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a0924bb5-5cf1-4dce-a943-753d29b3fb7dBuilds on10
- What is Local Optimality in Nonconvex-Nonconcave Minimax Optimization?Chi Jin, Praneeth Netrapalli, Michael I. JordanICML 2020 · 381 citations
- Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax ProblemsLuo Luo, Haishan Ye, Zhichao Huang, Tong ZhangNeurIPS 2020 · 152 citations
- Faster Rates of Convergence to Stationary Points in Differentially Private OptimizationRaman Arora, Raef Bassily, Tomás González, Cristóbal Guzmán et al.ICML 2023 · 37 citations
- Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax OptimizationLiang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao HeNeurIPS 2022 · 25 citations
- Finding Second-Order Stationary Points in Nonconvex-Strongly-Concave Minimax OptimizationLuo Luo, Yujun Li, Cheng ChenNeurIPS 2022 · 22 citations
Related papers
- Second-Order Convergence in Private Stochastic Non-Convex OptimizationYouming Tao, Zuyuan Zhang, Dongxiao Yu, Xiuzhen Cheng et al.NeurIPS 2025 · 4 citations
- Improved Rates of Differentially Private Nonconvex-Strongly-Concave Minimax OptimizationRuijia Zhang, Mingxi Lei, Meng Ding, Zihang Xiang et al.AAAI 2025 · 7 citations
- Adaptive Batch Size for Privately Finding Second-Order Stationary PointsDaogao Liu, Kunal TalwarICLR 2025
- Momentum Aggregation for Private Non-convex ERMHoang Tran, Ashok CutkoskyNeurIPS 2022 · 14 citations
- Private Zeroth-Order Nonsmooth Nonconvex OptimizationQinzi Zhang, Hoang Tran, Ashok CutkoskyICLR 2024 · 9 citations
