Optimization Algorithm Design via Electric Circuits
Stephen P. Boyd, Tetiana Parshakova, Ernest K. Ryu, Jaewook J. Suh
摘要
We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose continuous-time dynamics converge to the solution of the optimization problem at hand. Then, the second stage is an automated, computer-assisted discretization of the continuous-time dynamics, yielding a provably convergent discrete-time algorithm. Our methodology recovers many classical (distributed) optimization algorithms and enables users to quickly design and explore a wide range of new algorithms with convergence guarantees.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O(1/k^2) Rate on Squared Gradient NormTaeho Yoon, Ernest K. RyuICML 2021 · 被引用 138 次
- Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax ProblemsSucheol Lee, Donghwan KimNeurIPS 2021 · 被引用 125 次
- Conformal Symplectic and Relativistic OptimizationGuilherme França, Jeremias Sulam, Daniel P. Robinson, René VidalNeurIPS 2020 · 被引用 81 次
- Exact Optimal Accelerated Complexity for Fixed-Point IterationsJisun Park, Ernest K. RyuICML 2022 · 被引用 50 次
- Continuized Accelerations of Deterministic and Stochastic Gradient Descents, and of Gossip AlgorithmsMathieu Even, Raphaël Berthier, Francis R. Bach, Nicolas Flammarion 等NeurIPS 2021 · 被引用 22 次
相关 Paper
- A Unified Discretization Framework for Differential Equation Approach with Lyapunov Arguments for Convex OptimizationKansei Ushiyama, Shun Sato, Takayasu MatsuoNeurIPS 2023 · 被引用 13 次
- Breaking the Convergence Barrier: Optimization via Fixed-Time Convergent FlowsParam Budhraja, Mayank Baranwal, Kunal Garg, Ashish R. HotaAAAI 2022 · 被引用 15 次
- Continuous-time Lower Bounds for Gradient-based AlgorithmsMichael Muehlebach, Michael I. JordanICML 2020 · 被引用 13 次
- Continuous-Time Analysis of Accelerated Gradient Methods via Conservation Laws in Dilated Coordinate SystemsJaewook J. Suh, Gyumin Roh, Ernest K. RyuICML 2022 · 被引用 16 次
- DesignX: Human-Competitive Algorithm Designer for Black-Box OptimizationHongshu Guo, Zeyuan Ma, Yining Ma, Xinglin Zhang 等NeurIPS 2025 · 被引用 7 次
