Optimal Robust Learning of Discrete Distributions from Batches
Ayush Jain, Alon Orlitsky
Abstract
Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy, erroneous, faulty, or even adversarial. Previous estimators for this setting ran in exponential time, and for some regimes required a suboptimal number of batches. We provide the first polynomial-time estimator that is optimal in the number of batches and achieves essentially the best possible estimation accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c0db00da-dc68-419b-9cdc-99fa4d2560eeCited by top-tier papers6
- A General Method for Robust Learning from BatchesAyush Jain, Alon OrlitskyNeurIPS 2020 · 17 citations
- Robust Testing and Estimation under Manipulation AttacksJayadev Acharya, Ziteng Sun, Huanyu ZhangICML 2021 · 13 citations
- Robust Density Estimation from Batches: The Best Things in Life are (Nearly) FreeAyush Jain, Alon OrlitskyICML 2021 · 10 citations
- Efficient List-Decodable Regression using BatchesAbhimanyu Das, Ayush Jain, Weihao Kong, Rajat SenICML 2023 · 5 citations
- Linear Regression using Heterogeneous Data BatchesAyush Jain, Rajat Sen, Weihao Kong, Abhimanyu Das et al.NeurIPS 2024 · 3 citations
Builds on1
Related papers
- Robust Estimation Under Heterogeneous Corruption RatesSyomantak Chaudhuri, Jerry Li, Thomas A. CourtadeNeurIPS 2025
- Distributed Estimation with Multiple Samples per User: Sharp Rates and Phase TransitionJayadev Acharya, Clément L. Canonne, Yuhan Liu, Ziteng Sun et al.NeurIPS 2021 · 16 citations
- Learning Structured Distributions From Untrusted Batches: Faster and SimplerSitan Chen, Jerry Li, Ankur MoitraNeurIPS 2020 · 19 citations
- TURF: Two-Factor, Universal, Robust, Fast Distribution Learning AlgorithmYi Hao, Ayush Jain, Alon Orlitsky, Vaishakh RavindrakumarICML 2022
- Refinement Methods for Distributed Distribution Estimation under ℓp-LossesDeheng Yuan, Tao Guo, Zhongyi HuangNeurIPS 2025
