Constrained Optimization From a Control Perspective via Feedback Linearization
Runyu Zhang, Arvind Raghunathan, Jeff S. Shamma, Na Li
摘要
Tools from control and dynamical systems have proven valuable for analyzing and developing optimization methods. In this paper, we establish rigorous theoretical foundations for using feedback linearization (FL) -- a well-established nonlinear control technique -- to solve constrained optimization problems. For equality-constrained optimization, we establish global convergence rates to first-order Karush-Kuhn-Tucker (KKT) points and uncover the close connection between the FL method and the Sequential Quadratic Programming (SQP) algorithm. Building on this relationship, we extend the FL approach to handle inequality-constrained problems. Furthermore, we introduce a momentum-accelerated feedback linearization algorithm and provide a rigorous convergence guarantee.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- Optimizing Federated Learning on Non-IID Data with Reinforcement LearningHao Wang, Zakhary Kaplan, Di Niu, Baochun LiINFOCOM 2020 · 被引用 1,002 次
- A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat MinimaZeke Xie, Issei Sato, Masashi SugiyamaICLR 2021 · 被引用 165 次
- LyaNet: A Lyapunov Framework for Training Neural ODEsIvan Dario Jimenez Rodriguez, Aaron D. Ames, Yisong YueICML 2022 · 被引用 78 次
- An Agnostic Approach to Federated Learning with Class ImbalanceZebang Shen, Juan Cerviño, Hamed Hassani, Alejandro RibeiroICLR 2022 · 被引用 69 次
- Continuous vs. Discrete Optimization of Deep Neural NetworksOmer Elkabetz, Nadav CohenNeurIPS 2021 · 被引用 51 次
相关 Paper
- SLM: A Smoothed First-Order Lagrangian Method for Structured Constrained Nonconvex OptimizationSongtao LuNeurIPS 2023 · 被引用 25 次
- Stochastic Momentum Methods for Non-smooth Non-Convex Finite-Sum Coupled Compositional OptimizationXingyu Chen, Bokun Wang, Min Yang, Qihang Lin 等NeurIPS 2025
- Convergence of a Stochastic Gradient Method with Momentum for Non-Smooth Non-Convex OptimizationVien V. Mai, Mikael JohanssonICML 2020 · 被引用 10 次
- MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-regularized OptimizationLuxuan Li, Chunfeng Cui, Xiao WangICML 2026
- Inexact Augmented Lagrangian Methods for Conic Optimization: Quadratic Growth and Linear ConvergenceFeng-Yi Liao, Lijun Ding, Yang ZhengNeurIPS 2024 · 被引用 3 次
