Optimization Algorithm Design via Electric Circuits
Stephen P. Boyd, Tetiana Parshakova, Ernest K. Ryu, Jaewook J. Suh
Abstract
We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose continuous-time dynamics converge to the solution of the optimization problem at hand. Then, the second stage is an automated, computer-assisted discretization of the continuous-time dynamics, yielding a provably convergent discrete-time algorithm. Our methodology recovers many classical (distributed) optimization algorithms and enables users to quickly design and explore a wide range of new algorithms with convergence guarantees.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 180e01d5-9682-4c7a-b52c-0104d215c569Builds on11
- Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient NormTaeho Yoon, Ernest K. RyuICML 2021 · 138 citations
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 125 citations
- Conformal Symplectic and Relativistic OptimizationGuilherme França, Jeremias Sulam, Daniel P. Robinson, René VidalNeurIPS 2020 · 81 citations
- Exact Optimal Accelerated Complexity for Fixed-Point IterationsJisun Park, Ernest K. RyuICML 2022 · 50 citations
- Continuized Accelerations of Deterministic and Stochastic Gradient Descents, and of Gossip AlgorithmsMathieu Even, Raphaël Berthier, Francis R. Bach, Nicolas Flammarion et al.NeurIPS 2021 · 22 citations
Related papers
- A Unified Discretization Framework for Differential Equation Approach with Lyapunov Arguments for Convex OptimizationKansei Ushiyama, Shun Sato, Takayasu MatsuoNeurIPS 2023 · 13 citations
- Breaking the Convergence Barrier: Optimization via Fixed-Time Convergent FlowsParam Budhraja, Mayank Baranwal, Kunal Garg, Ashish R. HotaAAAI 2022 · 15 citations
- Continuous-time Lower Bounds for Gradient-based AlgorithmsMichael Muehlebach, Michael I. JordanICML 2020 · 13 citations
- Continuous-Time Analysis of Accelerated Gradient Methods via Conservation Laws in Dilated Coordinate SystemsJaewook J. Suh, Gyumin Roh, Ernest K. RyuICML 2022 · 16 citations
- DesignX: Human-Competitive Algorithm Designer for Black-Box OptimizationHongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang et al.NeurIPS 2025 · 7 citations
