The Burer-Monteiro SDP method can fail even above the Barvinok-Pataki bound
Liam O'Carroll, Vaidehi Srinivas, Aravindan Vijayaraghavan
Abstract
The most widely used technique for solving large-scale semidefinite programs (SDPs) in practice is the non-convex Burer-Monteiro method, which explicitly maintains a low-rank SDP solution for memory efficiency. There has been much recent interest in obtaining a better theoretical understanding of the Burer-Monteiro method. When the maximum allowed rank of the SDP solution is above the Barvinok-Pataki bound (where a globally optimal solution of rank at most is guaranteed to exist), a recent line of work established convergence to a global optimum for generic or smoothed instances of the problem. However, it was open whether there even exists an instance in this regime where the Burer-Monteiro method fails. We prove that the Burer-Monteiro method can fail for the Max-Cut SDP on vertices when the rank is above the Barvinok-Pataki bound (). We provide a family of instances that have spurious local minima even when the rank . Combined with existing guarantees, this settles the question of the existence of spurious local minima for the Max-Cut formulation in all ranges of the rank and justifies the use of beyond worst-case paradigms like smoothed analysis to obtain guarantees for the Burer-Monteiro method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Are Graph Neural Networks Optimal Approximation Algorithms?Morris Yau, Nikolaos Karalias, Eric Lu, Jessica Xu et al.NeurIPS 2024 · 23 citations
- Tight Certification of Adversarially Trained Neural Networks via Nonconvex Low-Rank Semidefinite RelaxationsHong-Ming Chiu, Richard Y. ZhangICML 2023 · 4 citations
Related papers
- Polynomial time guarantees for the Burer-Monteiro methodDiego Cifuentes, Ankur MoitraNeurIPS 2022 · 40 citations
- Semidefinite Programming versus Burer-Monteiro Factorization for Matrix SensingBaturalp Yalçin, Ziye Ma, Javad Lavaei, Somayeh SojoudiAAAI 2023 · 8 citations
- General Low-rank Matrix Optimization: Geometric Analysis and Sharper BoundsHaixiang Zhang, Yingjie Bi, Javad LavaeiNeurIPS 2021 · 26 citations
- Statistically Optimal K-means Clustering via Nonnegative Low-rank Semidefinite ProgrammingYubo Zhuang, Xiaohui Chen, Yun Yang, Richard Y. ZhangICLR 2024 · 9 citations
- Scaling Convex Neural Networks with Burer-Monteiro FactorizationArda Sahiner, Tolga Ergen, Batu Ozturkler, John M. Pauly et al.ICLR 2024 · 4 citations
