Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation
Du Chen, Geoffrey A. Chua
摘要
We study convex resource allocation problems with m hard constraints under ( ε, δ ) - joint differential privacy (Joint-DP or JDP) in an offline setting. To approximately solve the problem, we propose a generic algorithm called Noisy Dual Mirror Descent. The algorithm applies noisy Mirror Descent to a dual problem from relaxing the hard constraints for private shadow prices, and then uses the shadow prices to coordinate allocations in the primal problem. Leveraging weak duality theory, we show that the optimality gap is upper bounded by O ( √ m ln(1 /δ ) ε ) , and constraint violation is no more than O ( √ m ln(1 /δ ) ε ) per constraint. When strong duality holds, both preceding results can be improved to (cid:101) O ( √ ln(1 /δ ) ε ) by better utilizing the geometric structure of the dual space, which is neglected by existing works. To complement our results under strong duality, we derive a minimax lower bound Ω (cid:0) mε (cid:1) for any JDP algorithm outputting feasible allocations. The lower bound matches our upper bounds up to some logarithmic factors for ε ≥ max 1 , 1 / ( nγ ) , where nγ is the available resource level. Numerical studies further confirm the effectiveness of our algorithm.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Private Stochastic Convex Optimization: Optimal Rates in L1 GeometryHilal Asi, Vitaly Feldman, Tomer Koren, Kunal TalwarICML 2021 · 被引用 106 次
- Dual Mirror Descent for Online Allocation ProblemsSantiago R. Balseiro, Haihao Lu, Vahab S. MirrokniICML 2020 · 被引用 102 次
- Private Reinforcement Learning with PAC and Regret GuaranteesGiuseppe Vietri, Borja Balle, Akshay Krishnamurthy, Zhiwei Steven WuICML 2020 · 被引用 70 次
- Faster Rates of Convergence to Stationary Points in Differentially Private OptimizationRaman Arora, Raef Bassily, Tomás González, Cristóbal Guzmán 等ICML 2023 · 被引用 37 次
相关 Paper
- Joint Online Learning and Decision-making via Dual Mirror DescentAlfonso Lobos, Paul Grigas, Zheng WenICML 2021 · 被引用 12 次
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale 等NeurIPS 2021 · 被引用 113 次
- Gradient-Variation Bound for Online Convex Optimization with ConstraintsShuang Qiu, Xiaohan Wei, Mladen KolarAAAI 2023 · 被引用 6 次
- Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax OptimizationLiang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao HeNeurIPS 2022 · 被引用 25 次
- Solving Positive Linear Programs with Differential PrivacyAlina Ene, Huy L Nguyen, Ta Duy Nguyen, Adrian VladuICML 2026
