Differentially Private Quasi-Concave Optimization: Bypassing the Lower Bound and Application to Geometric Problems
Kobbi Nissim, Eliad Tsfadia, Chao Yan
摘要
We study the sample complexity of differentially private optimization of quasi-concave functions. For a fixed input domain X , Cohen et al. [9] (STOC 2023) proved that any generic private optimizer for low sensitive quasi-concave functions must have sample complexity Ω(2 log * |X | ).
We show that the lower bound can be bypassed for a series of "natural" problems. We define a new class of approximated quasi-concave functions, and present a generic differentially private optimizer for approximated quasi-concave functions with sample complexity Õ (log * |X |). As applications, we use our optimizer to privately select a center point of points in d dimensions and probably approximately correct (PAC) learn d-dimensional halfspaces. In previous works, Bun et al. [7] (FOCS 2015) proved a lower bound of Ω(log * |X |) for both problems. Beimel et al. [4] (COLT 2019) and Kaplan et al. [17] (NeurIPS 2020) gave an upper bound of Õ(d 2.5 • 2 log * |X | ) for the two problems, respectively. We improve the dependency of the upper bounds on the cardinality of the domain by presenting a new upper bound of Õ(d 5.5 • log * |X |) for both problems. To the best of our understanding, this is the first work to reduce the sample complexity dependency on |X | for these two problems from exponential in log * |X | to log * |X |.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper1
相关 Paper
- Optimal Differentially Private Learning of Thresholds and Quasi-Concave OptimizationEdith Cohen, Xin Lyu, Jelani Nelson, Tamás Sarlós 等STOC 2023 · 被引用 4 次
- Differentially Private Stochastic Optimization: New Results in Convex and Non-Convex SettingsRaef Bassily, Cristóbal Guzmán, Michael MenartNeurIPS 2021 · 被引用 68 次
- Private estimation algorithms for stochastic block models and mixture modelsHongjie Chen, Vincent Cohen-Addad, Tommaso d'Orsi, Alessandro Epasto 等NeurIPS 2023 · 被引用 34 次
- Private optimization in the interpolation regime: faster rates and hardness resultsHilal Asi, Karan N. Chadha, Gary Cheng, John C. DuchiICML 2022 · 被引用 5 次
- Improved Differentially Private and Lazy Online Convex Optimization: Lower Regret without Smoothness RequirementsNaman Agarwal, Satyen Kale, Karan Singh, Abhradeep Guha ThakurtaICML 2024 · 被引用 1 次
