Instance-optimal Mean Estimation Under Differential Privacy
Ziyue Huang, Yuting Liang, Ke Yi
Abstract
Mean estimation under differential privacy is a fundamental problem, but worst-case optimal mechanisms do not offer meaningful utility guarantees in practice when the global sensitivity is very large. Instead, various heuristics have been proposed to reduce the error on real-world data that do not resemble the worst-case instance. This paper takes a principled approach, yielding a mechanism that is instance-optimal in a strong sense. In addition to its theoretical optimality, the mechanism is also simple and practical, and adapts to a variety of data characteristics without the need of parameter tuning. It easily extends to the local and shuffle model as well.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers36
- Covariance-Aware Private Mean Estimation Without Private Covariance EstimationGavin Brown, Marco Gaboardi, Adam D. Smith, Jonathan R. Ullman et al.NeurIPS 2021 · 59 citations
- New Lower Bounds for Private Estimation and a Generalized Fingerprinting LemmaGautam Kamath, Argyris Mouzakis, Vikrant SinghalNeurIPS 2022 · 41 citations
- R2T: Instance-optimal Truncation for Differentially Private Query Evaluation with Foreign KeysWei Dong, Juanru Fang, Ke Yi, Yuchao Tao et al.SIGMOD 2022 · 41 citations
- FriendlyCore: Practical Differentially Private AggregationEliad Tsfadia, Edith Cohen, Haim Kaplan, Yishay Mansour et al.ICML 2022 · 39 citations
- Tight and Robust Private Mean Estimation with Few UsersShyam Narayanan, Vahab S. Mirrokni, Hossein EsfandiariICML 2022 · 34 citations
Builds on6
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan et al.CCS 2016 · 7,620 citations
- Differentially Private Learning with Adaptive ClippingGalen Andrew, Om Thakkar, Brendan McMahan, Swaroop RamaswamyNeurIPS 2021 · 425 citations
- CoinPress: Practical Private Mean and Covariance EstimationSourav Biswas, Yihe Dong, Gautam Kamath, Jonathan R. UllmanNeurIPS 2020 · 134 citations
- Learning with User-Level PrivacyDaniel Levy, Ziteng Sun, Kareem Amin, Satyen Kale et al.NeurIPS 2021 · 113 citations
- Instance-optimality in differential privacy via approximate inverse sensitivity mechanismsHilal Asi, John C. DuchiNeurIPS 2020 · 72 citations
Related papers
- Shuffling-Aware Optimization for Private Vector Mean EstimationShun Takagi, Seng Pei LiewICML 2026 · 2 citations
- Almost Instance-optimal Clipping for Summation Problems in the Shuffle Model of Differential PrivacyWei Dong, Qiyao Luo, Giulia Fanti, Elaine Shi et al.CCS 2024
- Bridging Central and Local Differential Privacy in Data Acquisition MechanismsAlireza Fallah, Ali Makhdoumi, Azarakhsh Malekian, Asuman E. OzdaglarNeurIPS 2022 · 13 citations
- Subset-Based Instance Optimality in Private EstimationTravis Dick, Alex Kulesza, Ziteng Sun, Ananda Theertha SureshICML 2023 · 10 citations
- Sum Estimation under Personalized Local Differential PrivacyDajun Sun, Wei Dong, Yuan Qiu, Ke Yi et al.NeurIPS 2025 · 1 citation
