Local Constrained Bayesian Optimization
Jingzhe Jing, Zheyi Fan, Szu Hui Ng, Qingpei Hu
Abstract
Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailored for such settings. Unlike trust-region methods that are prone to premature shrinking when confronting tight or complex constraints, LCBO leverages the differentiable landscape of constraint-penalized surrogates to alternate between rapid local descent and uncertainty-driven exploration. Theoretically, we prove that LCBO achieves a convergence rate for the Karush-Kuhn-Tucker (KKT) residual that depends polynomially on the dimension for common kernels under mild assumptions, offering a rigorous alternative to global BO where regret bounds typically scale exponentially. Extensive evaluations on high-dimensional benchmarks (up to 100D) demonstrate that LCBO consistently outperforms state-of-the-art baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 68feb5f0-a798-4320-b5aa-264d3f8c4c21Builds on7
- Local policy search with Bayesian optimizationSarah Müller, Alexander von Rohr, Sebastian TrimpeNeurIPS 2021 · 67 citations
- Local Bayesian optimization via maximizing probability of descentQuan Nguyen, Kaiwen Wu, Jacob R. Gardner, Roman GarnettNeurIPS 2022 · 41 citations
- Sequential and Parallel Constrained Max-value Entropy Search via Information Lower BoundShion Takeno, Tomoyuki Tamura, Kazuki Shitara, Masayuki KarasuyamaICML 2022 · 27 citations
- The Behavior and Convergence of Local Bayesian OptimizationKaiwen Wu, Kyurae Kim, Roman Garnett, Jacob R. GardnerNeurIPS 2023 · 27 citations
- Minimizing UCB: a Better Local Search Strategy in Local Bayesian OptimizationZheyi Fan, Wenyu Wang, Szu Hui Ng, Qingpei HuNeurIPS 2024 · 14 citations
Related papers
- Local Latent Space Bayesian Optimization over Structured InputsNatalie Maus, Haydn Thomas Jones, Juston Moore, Matt J. Kusner et al.NeurIPS 2022 · 118 citations
- Re-Examining Linear Embeddings for High-Dimensional Bayesian OptimizationBenjamin Letham, Roberto Calandra, Akshara Rai, Eytan BakshyNeurIPS 2020 · 152 citations
- BayeSQP: Bayesian Optimization through Sequential Quadratic ProgrammingPaul Brunzema, Sebastian TrimpeNeurIPS 2025 · 7 citations
- BOIDS: High-Dimensional Bayesian Optimization via Incumbent-Guided Direction Lines and Subspace EmbeddingsLam Ngo, Huong Ha, Jeffrey Chan, Hongyu ZhangAAAI 2025
- Inversion-based Latent Bayesian OptimizationJaewon Chu, Jinyoung Park, Seunghun Lee, Hyunwoo J. KimNeurIPS 2024 · 17 citations
