Differentially Private Quasi-Concave Optimization: Bypassing the Lower Bound and Application to Geometric Problems
Kobbi Nissim, Eliad Tsfadia, Chao Yan
Abstract
We study the sample complexity of differentially private optimization of quasi-concave functions. For a fixed input domain X , Cohen et al. [9] (STOC 2023) proved that any generic private optimizer for low sensitive quasi-concave functions must have sample complexity Ω(2 log * |X | ).
We show that the lower bound can be bypassed for a series of "natural" problems. We define a new class of approximated quasi-concave functions, and present a generic differentially private optimizer for approximated quasi-concave functions with sample complexity Õ (log * |X |). As applications, we use our optimizer to privately select a center point of points in d dimensions and probably approximately correct (PAC) learn d-dimensional halfspaces. In previous works, Bun et al. [7] (FOCS 2015) proved a lower bound of Ω(log * |X |) for both problems. Beimel et al. [4] (COLT 2019) and Kaplan et al. [17] (NeurIPS 2020) gave an upper bound of Õ(d 2.5 • 2 log * |X | ) for the two problems, respectively. We improve the dependency of the upper bounds on the cardinality of the domain by presenting a new upper bound of Õ(d 5.5 • log * |X |) for both problems. To the best of our understanding, this is the first work to reduce the sample complexity dependency on |X | for these two problems from exponential in log * |X | to log * |X |.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 52fe6c70-073d-4d66-820e-53197071f92eBuilds on1
Related papers
- Optimal Differentially Private Learning of Thresholds and Quasi-Concave OptimizationEdith Cohen, Xin Lyu, Jelani Nelson, Tamás Sarlós et al.STOC 2023 · 4 citations
- Differentially Private Stochastic Optimization: New Results in Convex and Non-Convex SettingsRaef Bassily, Cristóbal Guzmán, Michael MenartNeurIPS 2021 · 68 citations
- Private estimation algorithms for stochastic block models and mixture modelsHongjie Chen, Vincent Cohen-Addad, Tommaso d'Orsi, Alessandro Epasto et al.NeurIPS 2023 · 34 citations
- Private optimization in the interpolation regime: faster rates and hardness resultsHilal Asi, Karan N. Chadha, Gary Cheng, John C. DuchiICML 2022 · 5 citations
- Improved Differentially Private and Lazy Online Convex Optimization: Lower Regret without Smoothness RequirementsNaman Agarwal, Satyen Kale, Karan Singh, Abhradeep Guha ThakurtaICML 2024 · 1 citation
