Robust Learning for Smoothed Online Convex Optimization with Feedback Delay
Pengfei Li, Jianyi Yang, Adam Wierman, Shaolei Ren
Abstract
We study a challenging form of Smoothed Online Convex Optimization, a.k.a. SOCO, including multi-step nonlinear switching costs and feedback delay. We propose a novel machine learning (ML) augmented online algorithm, Robustness-Constrained Learning (RCL), which combines untrusted ML predictions with a trusted expert online algorithm via constrained projection to robustify the ML prediction. Specifically,we prove that RCL is able to guarantee-competitiveness against any given expert for any, while also explicitly training the ML model in a robustification-aware manner to improve the average-case performance. Importantly,RCL is the first ML-augmented algorithm with a provable robustness guarantee in the case of multi-step switching cost and feedback delay.We demonstrate the improvement of RCL in both robustness and average performance using battery management for electrifying transportationas a case study.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab40f1b6-f0ea-4dd0-8ef0-ebf094b4898cCited by top-tier papers5
- Safe Exploitative Play with Untrusted Type BeliefsTongxin Li, Tinashe Handina, Shaolei Ren, Adam WiermanNeurIPS 2024 · 3 citations
- Disentangling Linear Quadratic Control with Untrusted ML PredictionsTongxin Li, Hao Liu, Yisong YueNeurIPS 2024 · 3 citations
- Online Budgeted Matching with General BidsJianyi Yang, Pengfei Li, Adam Wierman, Shaolei RenNeurIPS 2024 · 2 citations
- Online Matching with Stochastic Rewards: Provable Better Bound via Adversarial Reinforcement LearningQiankun Zhang, Aocheng Shen, Boyu Zhang, Hanrui Jiang et al.ICML 2024 · 2 citations
- Fairness-Regularized Online Optimization with Switching CostsPengfei Li, Yuelin Han, Adam Wierman, Shaolei RenNeurIPS 2025 · 2 citations
Builds on14
- Projection-Based Constrained Policy OptimizationTsung-Yen Yang, Justinian Rosca, Karthik Narasimhan, Peter J. RamadgeICLR 2020 · 306 citations
- Online metric algorithms with untrusted predictionsAntonios Antoniadis, Christian Coester, Marek Eliás, Adam Polak et al.ICML 2020 · 170 citations
- Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online AlgorithmsAlexander Wei, Fred ZhangNeurIPS 2020 · 129 citations
- Do Differentiable Simulators Give Better Policy Gradients?Hyung Ju Terry Suh, Max Simchowitz, Kaiqing Zhang, Russ TedrakeICML 2022 · 129 citations
- Conservative Offline Distributional Reinforcement LearningYecheng Jason Ma, Dinesh Jayaraman, Osbert BastaniNeurIPS 2021 · 118 citations
Related papers
- Robustified Learning for Online Optimization with Memory CostsPengfei Li, Jianyi Yang, Shaolei RenINFOCOM 2023 · 2 citations
- Smoothed Online Convex Optimization Based on Discounted-Normal-PredictorLijun Zhang, Wei Jiang, Jinfeng Yi, Tianbao YangNeurIPS 2022 · 13 citations
- Beyond Õ(√T)$ Constraint Violation for Online Convex Optimization with Adversarial ConstraintsAbhishek Sinha, Rahul VazeNeurIPS 2025 · 6 citations
- Constrained Online Convex Optimization with Memory and PredictionsMohammed Abdullah, George Iosifidis, Salah-Eddine Elayoubi, Tijani ChahedAAAI 2026
- Delay-Tolerant Constrained OCO with Application to Network Resource AllocationJuncheng Wang, Ben Liang, Min Dong, Gary Boudreau et al.INFOCOM 2021 · 11 citations
