Local Constrained Bayesian Optimization
Jingzhe Jing, Zheyi Fan, Szu Hui Ng, Qingpei Hu
摘要
Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailored for such settings. Unlike trust-region methods that are prone to premature shrinking when confronting tight or complex constraints, LCBO leverages the differentiable landscape of constraint-penalized surrogates to alternate between rapid local descent and uncertainty-driven exploration. Theoretically, we prove that LCBO achieves a convergence rate for the Karush-Kuhn-Tucker (KKT) residual that depends polynomially on the dimension for common kernels under mild assumptions, offering a rigorous alternative to global BO where regret bounds typically scale exponentially. Extensive evaluations on high-dimensional benchmarks (up to 100D) demonstrate that LCBO consistently outperforms state-of-the-art baselines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Local policy search with Bayesian optimizationSarah Müller, Alexander von Rohr, Sebastian TrimpeNeurIPS 2021 · 被引用 67 次
- Local Bayesian optimization via maximizing probability of descentQuan Nguyen, Kaiwen Wu, Jacob R. Gardner, Roman GarnettNeurIPS 2022 · 被引用 41 次
- Sequential and Parallel Constrained Max-value Entropy Search via Information Lower BoundShion Takeno, Tomoyuki Tamura, Kazuki Shitara, Masayuki KarasuyamaICML 2022 · 被引用 27 次
- The Behavior and Convergence of Local Bayesian OptimizationKaiwen Wu, Kyurae Kim, Roman Garnett, Jacob R. GardnerNeurIPS 2023 · 被引用 27 次
- Minimizing UCB: a Better Local Search Strategy in Local Bayesian OptimizationZheyi Fan, Wenyu Wang, Szu Hui Ng, Qingpei HuNeurIPS 2024 · 被引用 14 次
相关 Paper
- Local Latent Space Bayesian Optimization over Structured InputsNatalie Maus, Haydn Thomas Jones, Juston Moore, Matt J. Kusner 等NeurIPS 2022 · 被引用 118 次
- Re-Examining Linear Embeddings for High-Dimensional Bayesian OptimizationBenjamin Letham, Roberto Calandra, Akshara Rai, Eytan BakshyNeurIPS 2020 · 被引用 152 次
- BayeSQP: Bayesian Optimization through Sequential Quadratic ProgrammingPaul Brunzema, Sebastian TrimpeNeurIPS 2025 · 被引用 7 次
- BOIDS: High-Dimensional Bayesian Optimization via Incumbent-Guided Direction Lines and Subspace EmbeddingsLam Ngo, Huong Ha, Jeffrey Chan, Hongyu ZhangAAAI 2025
- Inversion-based Latent Bayesian OptimizationJaewon Chu, Jinyoung Park, Seunghun Lee, Hyunwoo J. KimNeurIPS 2024 · 被引用 17 次
