Reducing Adversarially Robust Learning to Non-Robust PAC Learning
Omar Montasser, Steve Hanneke, Nati Srebro
2020Year
35Citations
17Top-tier citations
Abstract
We study the problem of reducing adversarially robust learning to standard PAC learning, i.e. the complexity of learning adversarially robust predictors using access to only a black-box non-robust learner. We give a reduction that can robustly learn any hypothesis class using any non-robust learner for . The number of calls to depends logarithmically on the number of allowed adversarial perturbations per example, and we give a lower bound showing this is unavoidable.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b64fb158-41a9-4b46-b335-d3b37a8a9984Cited by top-tier papers17
- Cross-Entropy Loss Functions: Theoretical Analysis and ApplicationsAnqi Mao, Mehryar Mohri, Yutao ZhongICML 2023 · 790 citations
- Calibration and Consistency of Adversarial Surrogate LossesPranjal Awasthi, Natalie Frank, Anqi Mao, Mehryar Mohri et al.NeurIPS 2021 · 59 citations
- H-Consistency Bounds for Surrogate Loss MinimizersPranjal Awasthi, Anqi Mao, Mehryar Mohri, Yutao ZhongICML 2022 · 50 citations
- Optimal Learners for Realizable Regression: PAC Learning and Online LearningIdan Attias, Steve Hanneke, Alkis Kalavasis, Amin Karbasi et al.NeurIPS 2023 · 33 citations
- A PAC-Bayes Analysis of Adversarial RobustnessPaul Viallard, Guillaume Vidot, Amaury Habrard, Emilie MorvantNeurIPS 2021 · 21 citations
Builds on1
Related papers
- Black-box Certification and Learning under Adversarial PerturbationsHassan Ashtiani, Vinayak Pathak, Ruth UrnerICML 2020 · 21 citations
- A Characterization of Semi-Supervised Adversarially Robust PAC LearnabilityIdan Attias, Steve Hanneke, Yishay MansourNeurIPS 2022 · 19 citations
- On Proper Learnability between Average- and Worst-case RobustnessVinod Raman, Unique Subedi, Ambuj TewariNeurIPS 2023 · 5 citations
- The Complexity of Adversarially Robust Proper Learning of Halfspaces with Agnostic NoiseIlias Diakonikolas, Daniel M. Kane, Pasin ManurangsiNeurIPS 2020 · 23 citations
- Boosting Barely Robust Learners: A New Perspective on Adversarial RobustnessAvrim Blum, Omar Montasser, Greg Shakhnarovich, Hongyang ZhangNeurIPS 2022 · 3 citations
