Constrained Optimization From a Control Perspective via Feedback Linearization
Runyu Zhang, Arvind Raghunathan, Jeff S. Shamma, Na Li
Abstract
Tools from control and dynamical systems have proven valuable for analyzing and developing optimization methods. In this paper, we establish rigorous theoretical foundations for using feedback linearization (FL) -- a well-established nonlinear control technique -- to solve constrained optimization problems. For equality-constrained optimization, we establish global convergence rates to first-order Karush-Kuhn-Tucker (KKT) points and uncover the close connection between the FL method and the Sequential Quadratic Programming (SQP) algorithm. Building on this relationship, we extend the FL approach to handle inequality-constrained problems. Furthermore, we introduce a momentum-accelerated feedback linearization algorithm and provide a rigorous convergence guarantee.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5d542e3f-7757-4a09-baad-1beebf9da1b5Builds on6
- Optimizing Federated Learning on Non-IID Data with Reinforcement LearningHao Wang, Zakhary Kaplan, Di Niu, Baochun LiINFOCOM 2020 · 1,002 citations
- A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat MinimaZeke Xie, Issei Sato, Masashi SugiyamaICLR 2021 · 165 citations
- LyaNet: A Lyapunov Framework for Training Neural ODEsIvan Dario Jimenez Rodriguez, Aaron D. Ames, Yisong YueICML 2022 · 78 citations
- An Agnostic Approach to Federated Learning with Class ImbalanceZebang Shen, Juan Cerviño, Hamed Hassani, Alejandro RibeiroICLR 2022 · 69 citations
- Continuous vs. Discrete Optimization of Deep Neural NetworksOmer Elkabetz, Nadav CohenNeurIPS 2021 · 51 citations
Related papers
- SLM: A Smoothed First-Order Lagrangian Method for Structured Constrained Nonconvex OptimizationSongtao LuNeurIPS 2023 · 25 citations
- Stochastic Momentum Methods for Non-smooth Non-Convex Finite-Sum Coupled Compositional OptimizationXingyu Chen, Bokun Wang, Min Yang, Qihang Lin et al.NeurIPS 2025
- Convergence of a Stochastic Gradient Method with Momentum for Non-Smooth Non-Convex OptimizationVien V. Mai, Mikael JohanssonICML 2020 · 10 citations
- MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-regularized OptimizationLuxuan Li, Chunfeng Cui, Xiao WangICML 2026
- Inexact Augmented Lagrangian Methods for Conic Optimization: Quadratic Growth and Linear ConvergenceFeng-Yi Liao, Lijun Ding, Yang ZhengNeurIPS 2024 · 3 citations
