Exact Generalization Guarantees for (Regularized) Wasserstein Distributionally Robust Models
Waïss Azizian, Franck Iutzeler, Jérôme Malick
摘要
Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the training distribution is an exact upper bound on the true risk with high probability. However, existing guarantees either suffer from the curse of dimensionality, are restricted to specific settings, or lead to spurious error terms. In this paper, we show that these generalization guarantees actually hold on general classes of models, do not suffer from the curse of dimensionality, and can even cover distribution shifts at testing. We also prove that these results carry over to the newly-introduced regularized versions of Wasserstein distributionally robust problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Universal generalization guarantees for Wasserstein distributionally robust modelsTam Le, Jérôme MalickICLR 2025
- Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust OptimizationShuang Liu, Yihan Wang, Yifan Zhu, Yibo Miao 等ICLR 2025
它引用的顶会 Paper7
- Large-Scale Methods for Distributionally Robust OptimizationDaniel Levy, Yair Carmon, John C. Duchi, Aaron SidfordNeurIPS 2020 · 被引用 281 次
- Non-Convex Bilevel Games with Critical Point Selection MapsMichael Arbel, Julien MairalNeurIPS 2022 · 被引用 40 次
- Regularized Optimal Transport is Ground Cost AdversarialFrançois-Pierre Paty, Marco CuturiICML 2020 · 被引用 33 次
- Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector MachineJiajin Li, Caihua Chen, Anthony Man-Cho SoNeurIPS 2020 · 被引用 27 次
- Generalization Bounds for (Wasserstein) Robust OptimizationYang An, Rui GaoNeurIPS 2021 · 被引用 22 次
相关 Paper
- Outlier-Robust Wasserstein DROSloan Nietert, Ziv Goldfeld, Soroosh ShafieeNeurIPS 2023 · 被引用 26 次
- Hierarchically Robust Representation LearningQi Qian, Juhua Hu, Hao LiCVPR 2020
- Geometry-Calibrated DRO: Combating Over-Pessimism with Free Energy ImplicationsJiashuo Liu, Jiayun Wu, Tianyu Wang, Hao Zou 等ICML 2024 · 被引用 5 次
- Generalization Bounds with Minimal Dependency on Hypothesis Class via Distributionally Robust OptimizationYibo Zeng, Henry LamNeurIPS 2022 · 被引用 11 次
- Generalised Lipschitz Regularisation Equals Distributional RobustnessZac Cranko, Zhan Shi, Xinhua Zhang, Richard Nock 等ICML 2021 · 被引用 26 次
