Scalable Distributional Robustness in a Class of Non-Convex Optimization with Guarantees
Avinandan Bose, Arunesh Sinha, Tien Mai
摘要
Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex optimization which is used for decision making in prominent areas such as facility location and security games. In contrast to previous work, we find it more tractable to optimize the equivalent variance regularized form of DRO rather than the minimax form. We transform the variance regularized form to a mixed-integer second order cone program (MISOCP), which, while guaranteeing near global optimality, does not scale enough to solve problems with real world data-sets. We further propose two abstraction approaches based on clustering and stratified sampling to increase scalability, which we then use for real world data-sets. Importantly, we provide near global optimality guarantees for our approach and show experimentally that our solution quality is better than the locally optimal ones achieved by state-of-the-art gradient-based methods. We experimentally compare our different approaches and baselines, and reveal nuanced properties of a DRO solution. Preprint. Under review.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper3
- On Gradient Descent Ascent for Nonconvex-Concave Minimax ProblemsTianyi Lin, Chi Jin, Michael I. JordanICML 2020 · 被引用 587 次
- An Online Method for A Class of Distributionally Robust Optimization with Non-convex ObjectivesQi Qi, Zhishuai Guo, Yi Xu, Rong Jin 等NeurIPS 2021 · 被引用 61 次
- Stochastic Optimization for Non-convex Inf-Projection ProblemsYan Yan, Yi Xu, Lijun Zhang, Xiaoyu Wang 等ICML 2020 · 被引用 3 次
相关 Paper
- Learning Distributionally Robust Models at Scale via Composite OptimizationFarzin Haddadpour, Mohammad Mahdi Kamani, Mehrdad Mahdavi, Amin KarbasiICLR 2022 · 被引用 5 次
- Non-convex Distributionally Robust Optimization: Non-asymptotic AnalysisJikai Jin, Bohang Zhang, Haiyang Wang, Liwei WangNeurIPS 2021 · 被引用 65 次
- MixMax: Distributional Robustness in Function Space via Optimal Data MixturesAnvith Thudi, Chris J. MaddisonICLR 2025
- Adaptive Sampling for Stochastic Risk-Averse LearningSebastian Curi, Kfir Y. Levy, Stefanie Jegelka, Andreas KrauseNeurIPS 2020 · 被引用 65 次
- Outlier-Robust Wasserstein DROSloan Nietert, Ziv Goldfeld, Soroosh ShafieeNeurIPS 2023 · 被引用 26 次
