Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation
Du Chen, Geoffrey A. Chua
Abstract
We study convex resource allocation problems with m hard constraints under ( ε, δ ) - joint differential privacy (Joint-DP or JDP) in an offline setting. To approximately solve the problem, we propose a generic algorithm called Noisy Dual Mirror Descent. The algorithm applies noisy Mirror Descent to a dual problem from relaxing the hard constraints for private shadow prices, and then uses the shadow prices to coordinate allocations in the primal problem. Leveraging weak duality theory, we show that the optimality gap is upper bounded by O ( √ m ln(1 /δ ) ε ) , and constraint violation is no more than O ( √ m ln(1 /δ ) ε ) per constraint. When strong duality holds, both preceding results can be improved to (cid:101) O ( √ ln(1 /δ ) ε ) by better utilizing the geometric structure of the dual space, which is neglected by existing works. To complement our results under strong duality, we derive a minimax lower bound Ω (cid:0) mε (cid:1) for any JDP algorithm outputting feasible allocations. The lower bound matches our upper bounds up to some logarithmic factors for ε ≥ max 1 , 1 / ( nγ ) , where nγ is the available resource level. Numerical studies further confirm the effectiveness of our algorithm.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df2a1d94-697d-4e41-b602-94b00486f51dBuilds on4
- Private Stochastic Convex Optimization: Optimal Rates in L1 GeometryHilal Asi, Vitaly Feldman, Tomer Koren, Kunal TalwarICML 2021 · 106 citations
- Dual Mirror Descent for Online Allocation ProblemsSantiago R. Balseiro, Haihao Lu, Vahab S. MirrokniICML 2020 · 102 citations
- Private Reinforcement Learning with PAC and Regret GuaranteesGiuseppe Vietri, Borja Balle, Akshay Krishnamurthy, Zhiwei Steven WuICML 2020 · 70 citations
- Faster Rates of Convergence to Stationary Points in Differentially Private OptimizationRaman Arora, Raef Bassily, Tomás González, Cristóbal Guzmán et al.ICML 2023 · 37 citations
Related papers
- Joint Online Learning and Decision-making via Dual Mirror DescentAlfonso Lobos, Paul Grigas, Zheng WenICML 2021 · 12 citations
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale et al.NeurIPS 2021 · 113 citations
- Gradient-Variation Bound for Online Convex Optimization with ConstraintsShuang Qiu, Xiaohan Wei, Mladen KolarAAAI 2023 · 6 citations
- Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax OptimizationLiang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao HeNeurIPS 2022 · 25 citations
- Solving Positive Linear Programs with Differential PrivacyAlina Ene, Huy L Nguyen, Ta Duy Nguyen, Adrian VladuICML 2026
