Leveraging Predictions in Smoothed Online Convex Optimization via Gradient-based Algorithms
Yingying Li, Na Li
Abstract
We consider online convex optimization with time-varying stage costs and additional switching costs. Since the switching costs introduce coupling across all stages, multi-step-ahead (long-term) predictions are incorporated to improve the online performance. However, longer-term predictions tend to suffer from lower quality. Thus, a critical question is: how to reduce the impact of long-term prediction errors on the online performance? To address this question, we introduce a gradient-based online algorithm, Receding Horizon Inexact Gradient (RHIG), and analyze its performance by dynamic regrets in terms of the temporal variation of the environment and the prediction errors. RHIG only considers at most -step-ahead predictions to avoid being misled by worse predictions in the longer term. The optimal choice of suggested by our regret bounds depends on the tradeoff between the variation of the environment and the prediction accuracy. Additionally, we apply RHIG to a well-established stochastic prediction error model and provide expected regret and concentration bounds under correlated prediction errors. Lastly, we numerically test the performance of RHIG on quadrotor tracking problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Online Optimal Control with Affine ConstraintsYingying Li, Subhro Das, Na LiAAAI 2021 · 46 citations
- Revisiting Smoothed Online LearningLijun Zhang, Wei Jiang, Shiyin Lu, Tianbao YangNeurIPS 2021 · 41 citations
- Dynamic Regret of Randomized Online Service Caching in Edge ComputingSiqi Fan, I-Hong Hou, Van Sy MaiINFOCOM 2023 · 15 citations
- Smoothed Online Convex Optimization Based on Discounted-Normal-PredictorLijun Zhang, Wei Jiang, Jinfeng Yi, Tianbao YangNeurIPS 2022 · 13 citations
- Reinforcement Learning with Imperfect Transition Predictions: A Bellman-Jensen ApproachChenbei Lu, Zaiwei Chen, Tongxin Li, Chenye Wu et al.NeurIPS 2025 · 3 citations
Builds on1
Related papers
- Online Convex Optimization with Continuous Switching ConstraintGuanghui Wang, Yuanyu Wan, Tianbao Yang, Lijun ZhangNeurIPS 2021 · 14 citations
- Non-stationary Online Convex Optimization with Arbitrary DelaysYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangICML 2024 · 3 citations
- Constrained Online Convex Optimization with Memory and PredictionsMohammed Abdullah, George Iosifidis, Salah-Eddine Elayoubi, Tijani ChahedAAAI 2026
- Maximizing the Value of Predictions in Control: Accuracy Is Not EnoughYiheng Lin, Christopher Yeh, Zaiwei Chen, Adam WiermanNeurIPS 2025 · 2 citations
- Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and MemoryHao Qiu, Andrew Jacobsen, Emmanuel Esposito, Mengxiao ZhangICML 2026 · 2 citations
