Bounded-Regret MPC via Perturbation Analysis: Prediction Error, Constraints, and Nonlinearity
Yiheng Lin, Yang Hu, Guannan Qu, Tongxin Li, Adam Wierman
摘要
We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound is used to bound the per-step error of MPC, which leads to a bound on the dynamic regret. Thus, our pipeline reduces the study of MPC to the well-studied problem of perturbation analysis, enabling the derivation of regret bounds of MPC under a variety of settings. To demonstrate the power of our pipeline, we use it to generalize existing regret bounds on MPC in linear time-varying (LTV) systems to incorporate prediction errors on costs, dynamics, and disturbances. Further, our pipeline leads to regret bounds on MPC in systems with nonlinear dynamics and constraints.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Online Adaptive Policy Selection in Time-Varying Systems: No-Regret via Contractive PerturbationsYiheng Lin, James A. Preiss, Emile Anand, Yingying Li 等NeurIPS 2023 · 被引用 31 次
- Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value PredictionsTongxin Li, Yiheng Lin, Shaolei Ren, Adam WiermanNeurIPS 2023 · 被引用 14 次
- Reinforcement Learning with Lookahead InformationNadav MerlisNeurIPS 2024 · 被引用 11 次
- The Value of Reward Lookahead in Reinforcement LearningNadav Merlis, Dorian Baudry, Vianney PerchetNeurIPS 2024 · 被引用 6 次
- Anytime-Competitive Reinforcement Learning with Policy PriorJianyi Yang, Pengfei Li, Tongxin Li, Adam Wierman 等NeurIPS 2023 · 被引用 3 次
它引用的顶会 Paper4
- The Power of Predictions in Online ControlChenkai Yu, Guanya Shi, Soon-Jo Chung, Yisong Yue 等NeurIPS 2020 · 被引用 88 次
- Online Optimization with Memory and Competitive ControlGuanya Shi, Yiheng Lin, Soon-Jo Chung, Yisong Yue 等NeurIPS 2020 · 被引用 66 次
- Perturbation-based Regret Analysis of Predictive Control in Linear Time Varying SystemsYiheng Lin, Yang Hu, Guanya Shi, Haoyuan Sun 等NeurIPS 2021 · 被引用 55 次
- Online Control of Unknown Time-Varying Dynamical SystemsEdgar Minasyan, Paula Gradu, Max Simchowitz, Elad HazanNeurIPS 2021 · 被引用 38 次
相关 Paper
- Online Policy Gradient for Model Free Learning of Linear Quadratic Regulators with √T RegretAsaf B. Cassel, Tomer KorenICML 2021 · 被引用 20 次
- A Regret Minimization Approach to Iterative Learning ControlNaman Agarwal, Elad Hazan, Anirudha Majumdar, Karan SinghICML 2021 · 被引用 15 次
- Robust-Adaptive Control of Linear Systems: beyond Quadratic CostsEdouard Leurent, Odalric-Ambrym Maillard, Denis V. EfimovNeurIPS 2020 · 被引用 11 次
- Bandit Linear ControlAsaf B. Cassel, Tomer KorenNeurIPS 2020 · 被引用 19 次
- Online learning with dynamics: A minimax perspectiveKush Bhatia, Karthik SridharanNeurIPS 2020 · 被引用 18 次
