The Sharp Power Law of Local Search on Expanders
Simina Brânzei, Davin Choo, Nicholas J. Recker
Abstract
Local search is a powerful heuristic in optimization and computer science, the complexity of which has been studied in the white box and black box models. In the black box model, we are given a graph G = (V, E) and oracle access to a function f : V → R. The local search problem is to find a vertex v that is a local minimum, i.e. with f (v) ≤ f (u) for all (u, v) ∈ E, using as few queries to the oracle as possible. The query complexity is well understood on the grid and the hypercube, but much less is known beyond.
We show the query complexity of local search on d-regular expanders with constant degree is Ω √ n log n , where n is the number of vertices of the graph. This matches within a logarithmic factor the upper bound of O( √ n) for constant degree graphs from [Ald83], implying that steepest descent with a warm start is essentially an optimal algorithm for expanders. The best lower bound known from prior literature was Ω 8 √ n log n , shown by [SS04] for quantum and randomized algorithms.
We obtain this result by considering a broader framework of graph features such as vertex congestion and separation number. We show that for each graph, the randomized query complexity of local search is Ω n 1.5 g , where g is the vertex congestion of the graph; and Ω 4 s ∆ , where s is the separation number and ∆ is the maximum degree. For separation number the previous bound was Ω 8 s ∆ / log n , given by [SS04] for quantum and randomized algorithms. We also show a variant of the relational adversary method from [Aar06]. Our variant is asymptotically at least as strong as the version in [Aar06] for all randomized algorithms, as well as strictly stronger on some problems and easier to apply in our setting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- Complexity of Finding Stationary Points of Nonconvex Nonsmooth FunctionsJingzhao Zhang, Hongzhou Lin, Stefanie Jegelka, Suvrit Sra et al.ICML 2020 · 98 citations
- The Complexity of Finding Stationary Points with Stochastic Gradient DescentYoel Drori, Ohad ShamirICML 2020 · 73 citations
- The complexity of gradient descent: CLS = PPAD ∩ PLSJohn Fearnley, Paul W. Goldberg, Alexandros Hollender, Rahul SavaniSTOC 2021 · 23 citations
- The complexity of constrained min-max optimizationConstantinos Daskalakis, Stratis Skoulakis, Manolis ZampetakisSTOC 2021 · 18 citations
Related papers
- Deterministic Edge Connectivity and Max Flow using Subquadratic Cut QueriesAditya Anand, Thatchaphol Saranurak, Yunfan WangSODA 2025
- Cut Query Algorithms with Star ContractionSimon Apers, Yuval Efron, Pawel Gawrychowski, Troy Lee et al.FOCS 2022 · 5 citations
- The query complexity of certificationGuy Blanc, Caleb Koch, Jane Lange, Li-Yang TanSTOC 2022 · 1 citation
- Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility ProblemsMoïse BlanchardFOCS 2024 · 3 citations
- Computing and Testing Small Connectivity in Near-Linear Time and Queries via Fast Local Cut AlgorithmsSebastian Forster, Danupon Nanongkai, Liu Yang, Thatchaphol Saranurak et al.SODA 2020 · 29 citations
