Exact Generalization Guarantees for (Regularized) Wasserstein Distributionally Robust Models
Waïss Azizian, Franck Iutzeler, Jérôme Malick
Abstract
Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the training distribution is an exact upper bound on the true risk with high probability. However, existing guarantees either suffer from the curse of dimensionality, are restricted to specific settings, or lead to spurious error terms. In this paper, we show that these generalization guarantees actually hold on general classes of models, do not suffer from the curse of dimensionality, and can even cover distribution shifts at testing. We also prove that these results carry over to the newly-introduced regularized versions of Wasserstein distributionally robust problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Universal generalization guarantees for Wasserstein distributionally robust modelsTam Le, Jérôme MalickICLR 2025
- Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust OptimizationShuang Liu, Yihan Wang, Yifan Zhu, Yibo Miao et al.ICLR 2025
Builds on7
- Large-Scale Methods for Distributionally Robust OptimizationDaniel Levy, Yair Carmon, John C. Duchi, Aaron SidfordNeurIPS 2020 · 281 citations
- Non-Convex Bilevel Games with Critical Point Selection MapsMichael Arbel, Julien MairalNeurIPS 2022 · 40 citations
- Regularized Optimal Transport is Ground Cost AdversarialFrançois-Pierre Paty, Marco CuturiICML 2020 · 33 citations
- Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector MachineJiajin Li, Caihua Chen, Anthony Man-Cho SoNeurIPS 2020 · 27 citations
- Generalization Bounds for (Wasserstein) Robust OptimizationYang An, Rui GaoNeurIPS 2021 · 22 citations
Related papers
- Outlier-Robust Wasserstein DROSloan Nietert, Ziv Goldfeld, Soroosh ShafieeNeurIPS 2023 · 26 citations
- Hierarchically Robust Representation LearningQi Qian, Juhua Hu, Hao LiCVPR 2020
- Geometry-Calibrated DRO: Combating Over-Pessimism with Free Energy ImplicationsJiashuo Liu, Jiayun Wu, Tianyu Wang, Hao Zou et al.ICML 2024 · 5 citations
- Generalization Bounds with Minimal Dependency on Hypothesis Class via Distributionally Robust OptimizationYibo Zeng, Henry LamNeurIPS 2022 · 11 citations
- Generalised Lipschitz Regularisation Equals Distributional RobustnessZac Cranko, Zhan Shi, Xinhua Zhang, Richard Nock et al.ICML 2021 · 26 citations
