Characterization of Overfitting in Robust Multiclass Classification
Jingyuan Xu, Weiwei Liu
2023Year
4Citations
4Top-tier citations
Abstract
This paper considers the following question: Given the number of classes m, the number of robust accuracy queries k, and the number of test examples in the dataset n, how much can adaptive algorithms robustly overfit the test dataset? We solve this problem by equivalently giving near-matching upper and lower bounds of the robust overfitting bias in multiclass classification problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- DRF: Improving Certified Robustness via Distributional Robustness FrameworkZekai Wang, Zhengyu Zhou, Weiwei LiuAAAI 2024 · 7 citations
- On Learnability and Disambiguation of Multiclass Partial Concept ClassesJingyuan Xu, Xin Zou, Xiuwen Gong, Weiwei LiuICML 2026 · 2 citations
- Error Analysis of Spherically Constrained Least Squares Reformulation in Solving the Stackelberg Prediction GameXiyuan Li, Weiwei LiuNeurIPS 2024 · 1 citation
- The Reliability of OKRidge Method in Solving Sparse Ridge Regression ProblemsXiyuan Li, Youjun Wang, Weiwei LiuNeurIPS 2024
Builds on8
- Overfitting in adversarially robust deep learningLeslie Rice, Eric Wong, J. Zico KolterICML 2020 · 935 citations
- A Closer Look at Accuracy vs. RobustnessYao-Yuan Yang, Cyrus Rashtchian, Hongyang Zhang, Ruslan Salakhutdinov et al.NeurIPS 2020 · 336 citations
- Better Diffusion Models Further Improve Adversarial TrainingZekai Wang, Tianyu Pang, Chao Du, Min Lin et al.ICML 2023 · 300 citations
- On Robustness of Neural Ordinary Differential EquationsHanshu Yan, Jiawei Du, Vincent Y. F. Tan, Jiashi FengICLR 2020 · 161 citations
- On the Tradeoff Between Robustness and FairnessXinsong Ma, Zekai Wang, Weiwei LiuNeurIPS 2022 · 64 citations
Related papers
- On Robust Multiclass LearnabilityJingyuan Xu, Weiwei LiuNeurIPS 2022 · 10 citations
- Multiclass Boosting and the Cost of Weak LearningNataly Brukhim, Elad Hazan, Shay Moran, Indraneel Mukherjee et al.NeurIPS 2021 · 16 citations
- Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic ViewChristos Thrampoulidis, Samet Oymak, Mahdi SoltanolkotabiNeurIPS 2020 · 46 citations
- Generalization for multiclass classification with overparameterized linear modelsVignesh Subramanian, Rahul Arya, Anant SahaiNeurIPS 2022 · 12 citations
- Multiclass learning with margin: exponential rates with no bias-variance trade-offStefano Vigogna, Giacomo Meanti, Ernesto De Vito, Lorenzo RosascoICML 2022 · 3 citations
