Nearly-Linear Time Private Hypothesis Selection with the Optimal Approximation Factor
Maryam Aliakbarpour, Zhan Shi, Ria Stevens, Vincent X. Wang
Abstract
Estimating the density of a distribution from its samples is a fundamental problem in statistics. Hypothesis selection addresses the setting where, in addition to a sample set, we are given candidate distributions -- referred to as hypotheses -- and the goal is to determine which one best describes the underlying data distribution. This problem is known to be solvable very efficiently, requiring roughly samples and running in time. The quality of the output is measured via the total variation distance to the unknown distribution, and the approximation factor of the algorithm determines how large this distance is compared to the optimal distance achieved by the best candidate hypothesis. It is known that is the optimal approximation factor for this problem. We study hypothesis selection under the constraint of differential privacy. We propose a differentially private algorithm in the central model that runs in nearly-linear time with respect to the number of hypotheses, achieves the optimal approximation factor, and incurs only a modest increase in sample complexity, which remains polylogarithmic in . This resolves an open question posed by [Bun, Kamath, Steinke, Wu, NeurIPS 2019]. Prior to our work, existing upper bounds required quadratic time.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d4438ce2-5350-4f3d-9c93-55f067d5dc4aCited by top-tier papers1
Ask how each one uses itBuilds on7
- Private Identity Testing for High-Dimensional DistributionsClément L. Canonne, Gautam Kamath, Audra McMillan, Jonathan R. Ullman et al.NeurIPS 2020 · 42 citations
- Locally private non-asymptotic testing of discrete distributions is faster using interactive mechanismsThomas Berrett, Cristina ButuceaNeurIPS 2020 · 41 citations
- Hypothesis Selection with Memory ConstraintsMaryam Aliakbarpour, Mark Bun, Adam SmithNeurIPS 2023 · 6 citations
- Data Structures for Density EstimationAnders Aamand, Alexandr Andoni, Justin Y. Chen, Piotr Indyk et al.ICML 2023 · 6 citations
- Optimal Hypothesis Selection in (Almost) Linear TimeMaryam Aliakbarpour, Mark Bun, Adam SmithNeurIPS 2024 · 2 citations
Related papers
- Statistically Near-Optimal Hypothesis SelectionOlivier Bousquet, Mark Braverman, Gillat Kol, Klim Efremenko et al.FOCS 2021
- Optimal Private Median Estimation under Minimal Distributional AssumptionsChristos Tzamos, Emmanouil V. Vlatakis-Gkaragkounis, Ilias ZadikNeurIPS 2020 · 25 citations
- On Differentially Private Sampling from Gaussian and Product DistributionsBadih Ghazi, Xiao Hu, Ravi Kumar, Pasin ManurangsiNeurIPS 2023 · 7 citations
- Query-Efficient Locally Private Hypothesis Selection via the Scheffe GraphGautam Kamath, Alireza F. Pour, Matthew Regehr, David P. WoodruffNeurIPS 2025
- Privately Estimating a Gaussian: Efficient, Robust, and OptimalDaniel Alabi, Pravesh K. Kothari, Pranay Tankala, Prayaag Venkat et al.STOC 2023 · 8 citations
