Perturbation-based Regret Analysis of Predictive Control in Linear Time Varying Systems
Yiheng Lin, Yang Hu, Guanya Shi, Haoyuan Sun, Guannan Qu, Adam Wierman
Abstract
We study predictive control in a setting where the dynamics are time-varying and linear, and the costs are time-varying and well-conditioned. At each time step, the controller receives the exact predictions of costs, dynamics, and disturbances for the future time steps. We show that when the prediction window is sufficiently large, predictive control is input-to-state stable and achieves a dynamic regret of , where is a positive constant. This is the first dynamic regret bound on the predictive control of linear time-varying systems. Under more assumptions on the terminal costs, we also show that predictive control obtains the first competitive bound for the control of linear time-varying systems: . Our results are derived using a novel proof framework based on a perturbation bound that characterizes how a small change to the system parameters impacts the optimal trajectory.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 952867cb-c763-4292-8b39-6e7b9da15e0eCited by top-tier papers12
- Meta-Adaptive Nonlinear Control: Theory and AlgorithmsGuanya Shi, Kamyar Azizzadenesheli, Michael O'Connell, Soon-Jo Chung et al.NeurIPS 2021 · 62 citations
- Bounded-Regret MPC via Perturbation Analysis: Prediction Error, Constraints, and NonlinearityYiheng Lin, Yang Hu, Guannan Qu, Tongxin Li et al.NeurIPS 2022 · 31 citations
- Online Adaptive Policy Selection in Time-Varying Systems: No-Regret via Contractive PerturbationsYiheng Lin, James A. Preiss, Emile Anand, Yingying Li et al.NeurIPS 2023 · 31 citations
- Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value PredictionsTongxin Li, Yiheng Lin, Shaolei Ren, Adam WiermanNeurIPS 2023 · 14 citations
- Reinforcement Learning with Lookahead InformationNadav MerlisNeurIPS 2024 · 11 citations
Builds on3
- Naive Exploration is Optimal for Online LQRMax Simchowitz, Dylan J. FosterICML 2020 · 209 citations
- The Power of Predictions in Online ControlChenkai Yu, Guanya Shi, Soon-Jo Chung, Yisong Yue et al.NeurIPS 2020 · 88 citations
- Online Optimization with Memory and Competitive ControlGuanya Shi, Yiheng Lin, Soon-Jo Chung, Yisong Yue et al.NeurIPS 2020 · 66 citations
Related papers
- Maximizing the Value of Predictions in Control: Accuracy Is Not EnoughYiheng Lin, Christopher Yeh, Zaiwei Chen, Adam WiermanNeurIPS 2025 · 2 citations
- Online Control of Unknown Time-Varying Dynamical SystemsEdgar Minasyan, Paula Gradu, Max Simchowitz, Elad HazanNeurIPS 2021 · 38 citations
- Rate-Optimal Online Convex Optimization in Adaptive Linear ControlAsaf B. Cassel, Alon Peled-Cohen, Tomer KorenNeurIPS 2022 · 12 citations
- Bandit Linear ControlAsaf B. Cassel, Tomer KorenNeurIPS 2020 · 19 citations
- Logarithmic Regret for Adversarial Online ControlDylan J. Foster, Max SimchowitzICML 2020 · 82 citations
