The power of factorization mechanisms in local and central differential privacy
Alexander Edmonds, Aleksandar Nikolov, Jonathan R. Ullman
Abstract
We give new characterizations of the sample complexity of answering linear queries (statistical queries) in the local and central models of differential privacy: • In the non-interactive local model, we give the first approximate characterization of the sample complexity. Informally our bounds are tight to within polylogarithmic factors in the number of queries and desired accuracy. Our characterization extends to agnostic learning in the local model. • In the central model, we give a characterization of the sample complexity in the highaccuracy regime that is analogous to that of Nikolov, Talwar, and Zhang (STOC 2013), but is both quantitatively tighter and has a dramatically simpler proof. Our lower bounds apply equally to the empirical and population estimation problems. In both cases, our characterizations show that a particular factorization mechanism is approximately optimal, and the optimal sample complexity is bounded from above and below by well studied factorization norms of a matrix associated with the queries.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7348843c-4c30-4ddf-be8b-3faa7d197273Cited by top-tier papers33
- Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive StreamsSergey Denisov, H. Brendan McMahan, John Rush, Adam D. Smith et al.NeurIPS 2022 · 96 citations
- Iterative Methods for Private Synthetic Data: Unifying Framework and New MethodsTerrance Liu, Giuseppe Vietri, Steven WuNeurIPS 2021 · 85 citations
- (Amplified) Banded Matrix Factorization: A unified approach to private trainingChristopher A. Choquette-Choo, Arun Ganesh, Ryan McKenna, H. Brendan McMahan et al.NeurIPS 2023 · 67 citations
- Multi-Epoch Matrix Factorization Mechanisms for Private Machine LearningChristopher A. Choquette-Choo, Hugh Brendan McMahan, J. Keith Rush, Abhradeep Guha ThakurtaICML 2023 · 62 citations
- Answering Multi-Dimensional Range Queries under Local Differential PrivacyJianyu Yang, Tianhao Wang, Ninghui Li, Xiang Cheng et al.VLDB 2021 · 46 citations
Related papers
- On Learning and Refutation in Noninteractive Local Differential PrivacyAlexander Edmonds, Aleksandar Nikolov, Toniann PitassiNeurIPS 2022
- Optimality of Matrix Mechanism on ℓpp-metricZongrui Zou, Jingcheng Liu, Jalaj UpadhyayICLR 2025
- Private Query Release via the Johnson-Lindenstrauss TransformAleksandar NikolovSODA 2023 · 1 citation
- A workload-adaptive mechanism for linear queries under local differential privacyRyan McKenna, Raj Kumar Maity, Arya Mazumdar, Gerome MiklauVLDB 2020 · 13 citations
- Interaction is necessary for distributed learning with privacy or communication constraintsYuval Dagan, Vitaly FeldmanSTOC 2020 · 1 citation
