A General Method for Robust Learning from Batches
Ayush Jain, Alon Orlitsky
Abstract
In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of robust learning from batches, and determine the limits of both classification and distribution estimation over arbitrary, including continuous, domains. Building on these results, we derive the first robust agnostic computationally-efficient learning algorithms for piecewise-interval classification, and for piecewise-polynomial, monotone, log-concave, and gaussian-mixture distribution estimation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dfcaa421-3b98-49ab-9890-3f319678040bCited by top-tier papers6
- An Equivalence Between Data Poisoning and Byzantine Gradient AttacksSadegh Farhadkhani, Rachid Guerraoui, Lê Nguyên Hoang, Oscar VillemaudICML 2022 · 30 citations
- Learning Structured Distributions From Untrusted Batches: Faster and SimplerSitan Chen, Jerry Li, Ankur MoitraNeurIPS 2020 · 19 citations
- Robust Testing and Estimation under Manipulation AttacksJayadev Acharya, Ziteng Sun, Huanyu ZhangICML 2021 · 13 citations
- Robust Density Estimation from Batches: The Best Things in Life are (Nearly) FreeAyush Jain, Alon OrlitskyICML 2021 · 10 citations
- Efficient List-Decodable Regression using BatchesAbhimanyu Das, Ayush Jain, Weihao Kong, Rajat SenICML 2023 · 5 citations
Builds on2
Related papers
- Distribution Learnability and RobustnessShai Ben-David, Alex Bie, Gautam Kamath, Tosca LechnerNeurIPS 2023 · 5 citations
- SURF: A Simple, Universal, Robust, Fast Distribution Learning AlgorithmYi Hao, Ayush Jain, Alon Orlitsky, Vaishakh RavindrakumarNeurIPS 2020 · 6 citations
- Robust Estimation Under Heterogeneous Corruption RatesSyomantak Chaudhuri, Jerry Li, Thomas A. CourtadeNeurIPS 2025
- Nonparametric Density Estimation under Distribution DriftAlessio Mazzetto, Eli UpfalICML 2023 · 5 citations
- List-Decodable Sparse Mean EstimationShiwei Zeng, Jie ShenNeurIPS 2022 · 13 citations
