Bounded-Regret MPC via Perturbation Analysis: Prediction Error, Constraints, and Nonlinearity
Yiheng Lin, Yang Hu, Guannan Qu, Tongxin Li, Adam Wierman
Abstract
We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound is used to bound the per-step error of MPC, which leads to a bound on the dynamic regret. Thus, our pipeline reduces the study of MPC to the well-studied problem of perturbation analysis, enabling the derivation of regret bounds of MPC under a variety of settings. To demonstrate the power of our pipeline, we use it to generalize existing regret bounds on MPC in linear time-varying (LTV) systems to incorporate prediction errors on costs, dynamics, and disturbances. Further, our pipeline leads to regret bounds on MPC in systems with nonlinear dynamics and constraints.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 621b64c9-dc67-4781-8fdb-ef7b53fc1528Cited by top-tier papers9
- Online Adaptive Policy Selection in Time-Varying Systems: No-Regret via Contractive PerturbationsYiheng Lin, James A. Preiss, Emile Anand, Yingying Li et al.NeurIPS 2023 · 31 citations
- Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value PredictionsTongxin Li, Yiheng Lin, Shaolei Ren, Adam WiermanNeurIPS 2023 · 14 citations
- Reinforcement Learning with Lookahead InformationNadav MerlisNeurIPS 2024 · 11 citations
- The Value of Reward Lookahead in Reinforcement LearningNadav Merlis, Dorian Baudry, Vianney PerchetNeurIPS 2024 · 6 citations
- Anytime-Competitive Reinforcement Learning with Policy PriorJianyi Yang, Pengfei Li, Tongxin Li, Adam Wierman et al.NeurIPS 2023 · 3 citations
Builds on4
- The Power of Predictions in Online ControlChenkai Yu, Guanya Shi, Soon-Jo Chung, Yisong Yue et al.NeurIPS 2020 · 88 citations
- Online Optimization with Memory and Competitive ControlGuanya Shi, Yiheng Lin, Soon-Jo Chung, Yisong Yue et al.NeurIPS 2020 · 66 citations
- Perturbation-based Regret Analysis of Predictive Control in Linear Time Varying SystemsYiheng Lin, Yang Hu, Guanya Shi, Haoyuan Sun et al.NeurIPS 2021 · 55 citations
- Online Control of Unknown Time-Varying Dynamical SystemsEdgar Minasyan, Paula Gradu, Max Simchowitz, Elad HazanNeurIPS 2021 · 38 citations
Related papers
- Online Policy Gradient for Model Free Learning of Linear Quadratic Regulators with √T RegretAsaf B. Cassel, Tomer KorenICML 2021 · 20 citations
- A Regret Minimization Approach to Iterative Learning ControlNaman Agarwal, Elad Hazan, Anirudha Majumdar, Karan SinghICML 2021 · 15 citations
- Robust-Adaptive Control of Linear Systems: beyond Quadratic CostsEdouard Leurent, Odalric-Ambrym Maillard, Denis V. EfimovNeurIPS 2020 · 11 citations
- Bandit Linear ControlAsaf B. Cassel, Tomer KorenNeurIPS 2020 · 19 citations
- Online learning with dynamics: A minimax perspectiveKush Bhatia, Karthik SridharanNeurIPS 2020 · 18 citations
