Structured Neural-PI Control with End-to-End Stability and Output Tracking Guarantees
Wenqi Cui, Yan Jiang, Baosen Zhang, Yuanyuan Shi
摘要
We study the optimal control of multiple-input and multiple-output dynamical systems via the design of neural network-based controllers with stability and output tracking guarantees. While neural network-based nonlinear controllers have shown superior performance in various applications, their lack of provable guarantees has restricted their adoption in high-stake real-world applications. This paper bridges the gap between neural network-based controllers and the need for stabilization guarantees. Using equilibrium-independent passivity, a property present in a wide range of physical systems, we propose neural Proportional-Integral (PI) controllers that have provable guarantees of stability and zero steady-state output tracking error. The key structure is the strict monotonicity on proportional and integral terms, which is parameterized as gradients of strictly convex neural networks (SCNN). We construct SCNN with tunable softplus-β activations, which yields universal approximation capability and is also useful in incorporating communication constraints. In addition, the SCNNs serve as Lyapunov functions, giving us end-to-end performance guarantees. Experiments on traffic and power networks demonstrate that the proposed approach improves both transient and steady-state performances, while unstructured neural networks lead to unstable behaviors. Preprint. Under review.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution NetworksJianhong Wang, Wangkun Xu, Yunjie Gu, Wenbin Song 等NeurIPS 2021 · 被引用 216 次
- Multi-agent Reinforcement Learning for Networked System ControlTianshu Chu, Sandeep Chinchali, Sachin KattiICLR 2020 · 被引用 134 次
- Certified Monotonic Neural NetworksXingchao Liu, Xing Han, Na Zhang, Qiang LiuNeurIPS 2020 · 被引用 116 次
- Neural Lyapunov Control of Unknown Nonlinear Systems with Stability GuaranteesRuikun Zhou, Thanin Quartz, Hans De Sterck, Jun LiuNeurIPS 2022 · 被引用 109 次
- Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average RewardGuannan Qu, Yiheng Lin, Adam Wierman, Na LiNeurIPS 2020 · 被引用 99 次
相关 Paper
- Universal approximation power of deep residual neural networks via nonlinear control theoryPaulo Tabuada, Bahman GharesifardICLR 2021 · 被引用 31 次
- Almost Surely Stable Deep DynamicsNathan P. Lawrence, Philip D. Loewen, Michael G. Forbes, Johan U. Backström 等NeurIPS 2020 · 被引用 28 次
- Neural Lyapunov Control for Discrete-Time SystemsJunlin Wu, Andrew Clark, Yiannis Kantaros, Yevgeniy VorobeychikNeurIPS 2023 · 被引用 61 次
- Enforcing robust control guarantees within neural network policiesPriya L. Donti, Melrose Roderick, Mahyar Fazlyab, J. Zico KolterICLR 2021 · 被引用 12 次
- Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed SystemsFangda Gu, He Yin, Laurent El Ghaoui, Murat Arcak 等AAAI 2022 · 被引用 33 次
