Leveraging Public Data for Practical Private Query Release
Terrance Liu, Giuseppe Vietri, Thomas Steinke, Jonathan R. Ullman, Zhiwei Steven Wu
Abstract
In many statistical problems, incorporating priors can significantly improve performance. However, the use of prior knowledge in differentially private query release has remained underexplored, despite such priors commonly being available in the form of public datasets, such as previous US Census releases. With the goal of releasing statistics about a private dataset, we present PMW^Pub, which -- unlike existing baselines -- leverages public data drawn from a related distribution as prior information. We provide a theoretical analysis and an empirical evaluation on the American Community Survey (ACS) and ADULT datasets, which shows that our method outperforms state-of-the-art methods. Furthermore, PMW^Pub scales well to high-dimensional data domains, where running many existing methods would be computationally infeasible.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ffa9055-eafa-4b13-92a2-f682a602a246Cited by top-tier papers29
- Differentially Private Fine-tuning of Language ModelsDa Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi et al.ICLR 2022 · 494 citations
- Deep Learning with Label Differential PrivacyBadih Ghazi, Noah Golowich, Ravi Kumar, Pasin Manurangsi et al.NeurIPS 2021 · 193 citations
- AIM: An Adaptive and Iterative Mechanism for Differentially Private Synthetic DataRyan McKenna, Brett Mullins, Daniel Sheldon, Gerome MiklauVLDB 2022 · 136 citations
- Practical GAN-based synthetic IP header trace generation using NetShareYucheng Yin, Zinan Lin, Minhao Jin, Giulia Fanti et al.SIGCOMM 2022 · 106 citations
- Iterative Methods for Private Synthetic Data: Unifying Framework and New MethodsTerrance Liu, Giuseppe Vietri, Steven WuNeurIPS 2021 · 85 citations
Builds on6
- The Discrete Gaussian for Differential PrivacyClément L. Canonne, Gautam Kamath, Thomas SteinkeNeurIPS 2020 · 355 citations
- New Oracle-Efficient Algorithms for Private Synthetic Data ReleaseGiuseppe Vietri, Grace Tian, Mark Bun, Thomas Steinke et al.ICML 2020 · 86 citations
- Permute-and-Flip: A new mechanism for differentially private selectionRyan McKenna, Daniel SheldonNeurIPS 2020 · 66 citations
- Private Query Release Assisted by Public DataRaef Bassily, Albert Cheu, Shay Moran, Aleksandar Nikolov et al.ICML 2020 · 53 citations
- Private Post-GAN BoostingMarcel Neunhoeffer, Steven Wu, Cynthia DworkICLR 2021 · 30 citations
Related papers
- Learning-augmented private algorithms for multiple quantile releaseMikhail Khodak, Kareem Amin, Travis Dick, Sergei VassilvitskiiICML 2023 · 7 citations
- Differentially Private Query Release Through Adaptive ProjectionSergül Aydöre, William Brown, Michael Kearns, Krishnaram Kenthapadi et al.ICML 2021 · 78 citations
- Bias and Variance of Post-processing in Differential PrivacyKeyu Zhu, Pascal Van Hentenryck, Ferdinando FiorettoAAAI 2021 · 46 citations
- Private Query Release via the Johnson-Lindenstrauss TransformAleksandar NikolovSODA 2023 · 1 citation
- Efficient and Private Marginal Reconstruction with Local Non-NegativityBrett Mullins, Miguel Fuentes, Yingtai Xiao, Daniel Kifer et al.NeurIPS 2024 · 4 citations
