Leveraging Predictions in Smoothed Online Convex Optimization via Gradient-based Algorithms
Yingying Li, Na Li
摘要
We consider online convex optimization with time-varying stage costs and additional switching costs. Since the switching costs introduce coupling across all stages, multi-step-ahead (long-term) predictions are incorporated to improve the online performance. However, longer-term predictions tend to suffer from lower quality. Thus, a critical question is: how to reduce the impact of long-term prediction errors on the online performance? To address this question, we introduce a gradient-based online algorithm, Receding Horizon Inexact Gradient (RHIG), and analyze its performance by dynamic regrets in terms of the temporal variation of the environment and the prediction errors. RHIG only considers at most -step-ahead predictions to avoid being misled by worse predictions in the longer term. The optimal choice of suggested by our regret bounds depends on the tradeoff between the variation of the environment and the prediction accuracy. Additionally, we apply RHIG to a well-established stochastic prediction error model and provide expected regret and concentration bounds under correlated prediction errors. Lastly, we numerically test the performance of RHIG on quadrotor tracking problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Online Optimal Control with Affine ConstraintsYingying Li, Subhro Das, Na LiAAAI 2021 · 被引用 46 次
- Revisiting Smoothed Online LearningLijun Zhang, Wei Jiang, Shiyin Lu, Tianbao YangNeurIPS 2021 · 被引用 41 次
- Dynamic Regret of Randomized Online Service Caching in Edge ComputingSiqi Fan, I-Hong Hou, Van Sy MaiINFOCOM 2023 · 被引用 15 次
- Smoothed Online Convex Optimization Based on Discounted-Normal-PredictorLijun Zhang, Wei Jiang, Jinfeng Yi, Tianbao YangNeurIPS 2022 · 被引用 13 次
- Reinforcement Learning with Imperfect Transition Predictions: A Bellman-Jensen ApproachChenbei Lu, Zaiwei Chen, Tongxin Li, Chenye Wu 等NeurIPS 2025 · 被引用 3 次
它引用的顶会 Paper1
相关 Paper
- Online Convex Optimization with Continuous Switching ConstraintGuanghui Wang, Yuanyu Wan, Tianbao Yang, Lijun ZhangNeurIPS 2021 · 被引用 14 次
- Non-stationary Online Convex Optimization with Arbitrary DelaysYuanyu Wan, Chang Yao, Mingli Song, Lijun ZhangICML 2024 · 被引用 3 次
- Constrained Online Convex Optimization with Memory and PredictionsMohammed Abdullah, George Iosifidis, Salah-Eddine Elayoubi, Tijani ChahedAAAI 2026
- Maximizing the Value of Predictions in Control: Accuracy Is Not EnoughYiheng Lin, Christopher Yeh, Zaiwei Chen, Adam WiermanNeurIPS 2025 · 被引用 2 次
- Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and MemoryHao Qiu, Andrew Jacobsen, Emmanuel Esposito, Mengxiao ZhangICML 2026 · 被引用 2 次
