Locally Optimal Private Sampling: Beyond the Global Minimax
Hrad Ghoukasian, Bonwoo Lee, Shahab Asoodeh
Abstract
We study the problem of sampling from a distribution under local differential privacy (LDP). Given a private distribution , the goal is to generate a single sample from a distribution that remains close to in -divergence while satisfying the constraints of LDP. This task captures the fundamental challenge of producing realistic-looking data under strong privacy guarantees. While prior work by Park et al. (NeurIPS'24) focuses on global minimax-optimality across a class of distributions, we take a local perspective. Specifically, we examine the minimax risk in a neighborhood around a fixed distribution , and characterize its exact value, which depends on both and the privacy level. Our main result shows that the local minimax risk is determined by the global minimax risk when the distribution class is restricted to a neighborhood around . To establish this, we (1) extend previous work from pure LDP to the more general functional LDP framework, and (2) prove that the globally optimal functional LDP sampler yields the optimal local sampler when constrained to distributions near . Building on this, we also derive a simple closed-form expression for the locally minimax-optimal samplers which does not depend on the choice of -divergence. We further argue that this local framework naturally models private sampling with public data, where the public data distribution is represented by . In this setting, we empirically compare our locally optimal sampler to existing global methods, and demonstrate that it consistently outperforms global minimax samplers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8c7df84b-9877-4ac3-bd79-ecf4ecb25762Builds on16
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
- Personalized Federated Learning with First Order Model OptimizationMichael Zhang, Karan Sapra, Sanja Fidler, Serena Yeung et al.ICLR 2021 · 414 citations
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale et al.NeurIPS 2021 · 113 citations
- Instance-optimality in differential privacy via approximate inverse sensitivity mechanismsHilal Asi, John C. DuchiNeurIPS 2020 · 72 citations
- User-Level Differentially Private Learning via Correlated SamplingBadih Ghazi, Ravi Kumar, Pasin ManurangsiNeurIPS 2021 · 45 citations
Related papers
- Exactly Minimax-Optimal Locally Differentially Private SamplingHyun-Young Park, Shahab Asoodeh, Si-Hyeon LeeNeurIPS 2024 · 7 citations
- Minimax Risks and Optimal Procedures for Estimation under Functional Local Differential PrivacyBonwoo Lee, Jeongyoun Ahn, Cheolwoo ParkNeurIPS 2023 · 5 citations
- Optimal Private Median Estimation under Minimal Distributional AssumptionsChristos Tzamos, Emmanouil V. Vlatakis-Gkaragkounis, Ilias ZadikNeurIPS 2020 · 25 citations
- Instance-Optimality for Private KL Distribution EstimationJiayuan Ye, Vitaly Feldman, Kunal TalwarNeurIPS 2025
- On Differentially Private Sampling from Gaussian and Product DistributionsBadih Ghazi, Xiao Hu, Ravi Kumar, Pasin ManurangsiNeurIPS 2023 · 7 citations
