Multi-Objective Bayesian Optimization via Adaptive -Constraint Decomposition
Yaohong Yang, Sammie Katt, Samuel Kaski
Abstract
Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing multiple expensive black-box functions. However, existing MOBO methods often struggle with coverage, scalability, and handling constraints and preferences. In this work we propose STAGE-BO, Sequential Targeting Adaptive Gap-Filling -Constraint Bayesian Optimization: by analyzing the coverage of the surrogate Pareto front, our method identifies the Pareto front point with the largest uncovered gap, and uses its coordinates to define adaptive constraints in -constraint method, which transforms the problem into a sequence of inequality-constrained subproblems, efficiently solved via constrained expected improvement acquisition. Our approach provides uniform Pareto coverage without hypervolume computation and naturally handles constraints and preferences. Experiments on synthetic and real-world benchmarks demonstrate superior coverage and competitive hypervolume performance against state-of-the-art baselines. Our code implementation can be found at https://github.com/YangYaohong1/STAGE-BO.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan et al.CCS 2016 · 7,620 citations
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian OptimizationSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2020 · 428 citations
- Efficiently sampling functions from Gaussian process posteriorsJames T. Wilson, Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky et al.ICML 2020 · 186 citations
- Diversity-Guided Multi-Objective Bayesian Optimization With Batch EvaluationsMina Konakovic-Lukovic, Yunsheng Tian, Wojciech MatusikNeurIPS 2020 · 114 citations
Related papers
- MOBO-OSD: Batch Multi-Objective Bayesian Optimization via Orthogonal Search DirectionsLam Ngo, Huong Ha, Jeffrey Chan, Hongyu ZhangNeurIPS 2025 · 4 citations
- Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume ImprovementSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2021 · 276 citations
- Expected Hypervolume Improvement Is a Particular Hypervolume ImprovementJingda Deng, Jianyong Sun, Qingfu Zhang, Hui LiAAAI 2025 · 4 citations
- Unexpected Improvements to Expected Improvement for Bayesian OptimizationSebastian Ament, Samuel Daulton, David Eriksson, Maximilian Balandat et al.NeurIPS 2023 · 280 citations
- Covering Multiple Objectives with a Small Set of Solutions Using Bayesian OptimizationNatalie Maus, Kyurae Kim, Yimeng Zeng, Haydn Thomas Jones et al.NeurIPS 2025 · 1 citation
