Structured Neural-PI Control with End-to-End Stability and Output Tracking Guarantees
Wenqi Cui, Yan Jiang, Baosen Zhang, Yuanyuan Shi
Abstract
We study the optimal control of multiple-input and multiple-output dynamical systems via the design of neural network-based controllers with stability and output tracking guarantees. While neural network-based nonlinear controllers have shown superior performance in various applications, their lack of provable guarantees has restricted their adoption in high-stake real-world applications. This paper bridges the gap between neural network-based controllers and the need for stabilization guarantees. Using equilibrium-independent passivity, a property present in a wide range of physical systems, we propose neural Proportional-Integral (PI) controllers that have provable guarantees of stability and zero steady-state output tracking error. The key structure is the strict monotonicity on proportional and integral terms, which is parameterized as gradients of strictly convex neural networks (SCNN). We construct SCNN with tunable softplus-β activations, which yields universal approximation capability and is also useful in incorporating communication constraints. In addition, the SCNNs serve as Lyapunov functions, giving us end-to-end performance guarantees. Experiments on traffic and power networks demonstrate that the proposed approach improves both transient and steady-state performances, while unstructured neural networks lead to unstable behaviors. Preprint. Under review.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 69abf3fb-aed0-449e-8734-de85be82b561Builds on7
- Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution NetworksJianhong Wang, Wangkun Xu, Yunjie Gu, Wenbin Song et al.NeurIPS 2021 · 216 citations
- Multi-agent Reinforcement Learning for Networked System ControlTianshu Chu, Sandeep Chinchali, Sachin KattiICLR 2020 · 134 citations
- Certified Monotonic Neural NetworksXingchao Liu, Xing Han, Na Zhang, Qiang LiuNeurIPS 2020 · 116 citations
- Neural Lyapunov Control of Unknown Nonlinear Systems with Stability GuaranteesRuikun Zhou, Thanin Quartz, Hans De Sterck, Jun LiuNeurIPS 2022 · 109 citations
- Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average RewardGuannan Qu, Yiheng Lin, Adam Wierman, Na LiNeurIPS 2020 · 99 citations
Related papers
- Universal approximation power of deep residual neural networks via nonlinear control theoryPaulo Tabuada, Bahman GharesifardICLR 2021 · 31 citations
- Almost Surely Stable Deep DynamicsNathan P. Lawrence, Philip D. Loewen, Michael G. Forbes, Johan U. Backström et al.NeurIPS 2020 · 28 citations
- Neural Lyapunov Control for Discrete-Time SystemsJunlin Wu, Andrew Clark, Yiannis Kantaros, Yevgeniy VorobeychikNeurIPS 2023 · 61 citations
- Enforcing robust control guarantees within neural network policiesPriya L. Donti, Melrose Roderick, Mahyar Fazlyab, J. Zico KolterICLR 2021 · 12 citations
- Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed SystemsFangda Gu, He Yin, Laurent El Ghaoui, Murat Arcak et al.AAAI 2022 · 33 citations
