Robust Estimation Under Heterogeneous Corruption Rates
Syomantak Chaudhuri, Jerry Li, Thomas A. Courtade
Abstract
We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated learning, crowdsourcing, and sensor networks, yet existing robust estimators typically assume uniform or worst-case corruption, ignoring structural heterogeneity. For mean estimation for multivariate bounded distributions and univariate gaussian distributions, we give tight minimax rates for all heterogeneous corruption patterns. For multivariate gaussian mean estimation and linear regression, we establish the minimax rate for squared error up to a factor of , where is the dimension. Roughly, our findings suggest that samples beyond a certain corruption threshold may be discarded by the optimal estimators -- this threshold is determined by the empirical distribution of the corruption rates given.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c88749fa-be01-42bc-ae57-62a690ee337cCited by top-tier papers1
Ask how each one uses itBuilds on9
- Robust and Heavy-Tailed Mean Estimation Made Simple, via Regret MinimizationSamuel B. Hopkins, Jerry Li, Fred ZhangNeurIPS 2020 · 74 citations
- List Decodable Learning via Sum of SquaresPrasad Raghavendra, Morris YauSODA 2020 · 44 citations
- From Robustness to Privacy and BackHilal Asi, Jonathan R. Ullman, Lydia ZakynthinouICML 2023 · 39 citations
- Privacy Induces Robustness: Information-Computation Gaps and Sparse Mean EstimationKristian Georgiev, Samuel B. HopkinsNeurIPS 2022 · 38 citations
- List-Decodable Mean Estimation via Iterative Multi-FilteringIlias Diakonikolas, Daniel Kane, Daniel KongsgaardNeurIPS 2020 · 23 citations
Related papers
- Robust Sparse Estimation for Gaussians with Optimal Error under Huber ContaminationIlias Diakonikolas, Daniel Kane, Sushrut Karmalkar, Ankit Pensia et al.ICML 2024 · 1 citation
- On Robust Mean Estimation under Coordinate-level CorruptionZifan Liu, Jongho Park, Theodoros Rekatsinas, Christos TzamosICML 2021 · 10 citations
- Minimax M-estimation under Adversarial ContaminationSujay Bhatt, Guanhua Fang, Ping Li, Gennady SamorodnitskyICML 2022 · 9 citations
- On the Optimality of the Median-of-Means Estimator under Adversarial ContaminationXabier de Juan, Santiago MazuelasNeurIPS 2025
- All-Purpose Mean Estimation over R: Optimal Sub-Gaussianity with Outlier Robustness and Low Moments PerformanceJasper C. H. Lee, Walter McKelvie, Maoyuan Song, Paul ValiantICML 2025
