Robust Learning for Smoothed Online Convex Optimization with Feedback Delay
Pengfei Li, Jianyi Yang, Adam Wierman, Shaolei Ren
摘要
We study a challenging form of Smoothed Online Convex Optimization, a.k.a. SOCO, including multi-step nonlinear switching costs and feedback delay. We propose a novel machine learning (ML) augmented online algorithm, Robustness-Constrained Learning (RCL), which combines untrusted ML predictions with a trusted expert online algorithm via constrained projection to robustify the ML prediction. Specifically,we prove that RCL is able to guarantee-competitiveness against any given expert for any, while also explicitly training the ML model in a robustification-aware manner to improve the average-case performance. Importantly,RCL is the first ML-augmented algorithm with a provable robustness guarantee in the case of multi-step switching cost and feedback delay.We demonstrate the improvement of RCL in both robustness and average performance using battery management for electrifying transportationas a case study.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Safe Exploitative Play with Untrusted Type BeliefsTongxin Li, Tinashe Handina, Shaolei Ren, Adam WiermanNeurIPS 2024 · 被引用 3 次
- Disentangling Linear Quadratic Control with Untrusted ML PredictionsTongxin Li, Hao Liu, Yisong YueNeurIPS 2024 · 被引用 3 次
- Online Budgeted Matching with General BidsJianyi Yang, Pengfei Li, Adam Wierman, Shaolei RenNeurIPS 2024 · 被引用 2 次
- Online Matching with Stochastic Rewards: Provable Better Bound via Adversarial Reinforcement LearningQiankun Zhang, Aocheng Shen, Boyu Zhang, Hanrui Jiang 等ICML 2024 · 被引用 2 次
- Fairness-Regularized Online Optimization with Switching CostsPengfei Li, Yuelin Han, Adam Wierman, Shaolei RenNeurIPS 2025 · 被引用 2 次
它引用的顶会 Paper14
- Projection-Based Constrained Policy OptimizationTsung-Yen Yang, Justinian Rosca, Karthik Narasimhan, Peter J. RamadgeICLR 2020 · 被引用 306 次
- Online metric algorithms with untrusted predictionsAntonios Antoniadis, Christian Coester, Marek Eliás, Adam Polak 等ICML 2020 · 被引用 170 次
- Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online AlgorithmsAlexander Wei, Fred ZhangNeurIPS 2020 · 被引用 129 次
- Do Differentiable Simulators Give Better Policy Gradients?Hyung Ju Terry Suh, Max Simchowitz, Kaiqing Zhang, Russ TedrakeICML 2022 · 被引用 129 次
- Conservative Offline Distributional Reinforcement LearningYecheng Jason Ma, Dinesh Jayaraman, Osbert BastaniNeurIPS 2021 · 被引用 118 次
相关 Paper
- Robustified Learning for Online Optimization with Memory CostsPengfei Li, Jianyi Yang, Shaolei RenINFOCOM 2023 · 被引用 2 次
- Smoothed Online Convex Optimization Based on Discounted-Normal-PredictorLijun Zhang, Wei Jiang, Jinfeng Yi, Tianbao YangNeurIPS 2022 · 被引用 13 次
- Beyond Õ(√T)$ Constraint Violation for Online Convex Optimization with Adversarial ConstraintsAbhishek Sinha, Rahul VazeNeurIPS 2025 · 被引用 6 次
- Constrained Online Convex Optimization with Memory and PredictionsMohammed Abdullah, George Iosifidis, Salah-Eddine Elayoubi, Tijani ChahedAAAI 2026
- Delay-Tolerant Constrained OCO with Application to Network Resource AllocationJuncheng Wang, Ben Liang, Min Dong, Gary Boudreau 等INFOCOM 2021 · 被引用 11 次
