Lune

ICML2026顶会

Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization

Difei Xu, Youming Tao, Meng Ding, Chenglin Fan, Di Wang

2026年份

摘要

We provide the first study of the problem of finding differentially private (DP) second-order stationary points (SOSP) in stochastic (non-convex) minimax optimization. Existing literature either focuses only on first-order stationary points for minimax problems or on SOSP for classical stochastic minimization problems. This work provides, for the first time, a unified and detailed treatment of both empirical and population risks. Specifically, we propose a purely first-order method that combines a nested gradient descent--ascent scheme with SPIDER-style variance reduction and Gaussian perturbations to ensure privacy. A key technical device is a block-wise (qq-period) analysis that controls the accumulation of stochastic variance and privacy noise without summing over the full iteration horizon, yielding a unified treatment of both empirical-risk and population formulations. Under standard smoothness, Hessian-Lipschitzness, and strong concavity assumptions, we establish high-probability guarantees for reaching an (α,ρΦα)(\alpha,\sqrt{\rho_\Phi \alpha})-approximate second-order stationary point with α=O((dnε)2/3)\alpha = \mathcal{O}( (\frac{\sqrt{d}}{n\varepsilon})^{2/3}) for empirical risk objectives and O(1n1/3+(dnε)1/2)\mathcal{O}(\frac{1}{n^{1/3}} + (\frac{\sqrt{d}}{n\varepsilon})^{1/2}) for population objectives, matching the best known rates for private first-order stationarity.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

它引用的顶会 Paper10

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖