Unified Lower Bounds for Interactive High-dimensional Estimation under Information Constraints
Jayadev Acharya, Clément L. Canonne, Ziteng Sun, Himanshu Tyagi
Abstract
We consider distributed parameter estimation using interactive protocols subject to local information constraints such as bandwidth limitations, local differential privacy, and restricted measurements. We provide a unified framework enabling us to derive a variety of (tight) minimax lower bounds for different parametric families of distributions, both continuous and discrete, under any loss. Our lower bound framework is versatile and yields"plug-and-play"bounds that are widely applicable to a large range of estimation problems, and, for the prototypical case of the Gaussian family, circumvents limitations of previous techniques. In particular, our approach recovers bounds obtained using data processing inequalities and Cramér--Rao bounds, two other alternative approaches for proving lower bounds in our setting of interest. Further, for the families considered, we complement our lower bounds with matching upper bounds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- Optimal Rates for Nonparametric Density Estimation under Communication ConstraintsJayadev Acharya, Clément L. Canonne, Aditya Vikram Singh, Himanshu TyagiNeurIPS 2021 · 19 citations
- Distributed Estimation with Multiple Samples per User: Sharp Rates and Phase TransitionJayadev Acharya, Clément L. Canonne, Yuhan Liu, Ziteng Sun et al.NeurIPS 2021 · 16 citations
- Private Statistical Estimation of Many QuantilesClément Lalanne, Aurélien Garivier, Rémi GribonvalICML 2023 · 6 citations
- Improved Analysis of Sparse Linear Regression in Local Differential Privacy ModelLiyang Zhu, Meng Ding, Vaneet Aggarwal, Jinhui Xu et al.ICLR 2024 · 5 citations
- Non-Stochastic CDF Estimation Using Threshold QueriesPrincewill Okoroafor, Vaishnavi Gupta, Robert KleinbergSODA 2023 · 2 citations
Builds on1
Related papers
- Optimal Private and Communication Constraint Distributed Goodness-of-Fit Testing for Discrete Distributions in the Large Sample RegimeLasse VuursteenNeurIPS 2024 · 1 citation
- Pointwise Bounds for Distribution Estimation under Communication ConstraintsWei-Ning Chen, Peter Kairouz, Ayfer ÖzgürNeurIPS 2021 · 8 citations
- Refinement Methods for Distributed Distribution Estimation under ℓp-LossesDeheng Yuan, Tao Guo, Zhongyi HuangNeurIPS 2025
- Distributed Nonparametric Estimation: from Sparse to Dense Samples per TerminalDeheng Yuan, Tao Guo, Zhongyi HuangICML 2025
- Fundamental Limits of Distributed Covariance Matrix Estimation Under Communication ConstraintsMohammad-Reza Rahmani, Mohammad Hossein Yassaee, Mohammad Ali Maddah-Ali, Mohammad Reza ArefICML 2024 · 1 citation
