Robust Multi-Objective Bayesian Optimization Under Input Noise
Samuel Daulton, Sait Cakmak, Maximilian Balandat, Michael A. Osborne, Enlu Zhou, Eytan Bakshy
Abstract
Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject to random input noise, resulting in a product that is often less performant than expected. Although BO methods have been proposed for optimizing a single objective under input noise, no existing method addresses the practical scenario where there are multiple objectives that are sensitive to input perturbations. In this work, we propose the first multi-objective BO method that is robust to input noise. We formalize our goal as optimizing the multivariate value-at-risk (MVaR), a risk measure of the uncertain objectives. Since directly optimizing MVaR is computationally infeasible in many settings, we propose a scalable, theoretically-grounded approach for optimizing MVaR using random scalarizations. Empirically, we find that our approach significantly outperforms alternative methods and efficiently identifies optimal robust designs that will satisfy specifications across multiple metrics with high probability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 554a184b-720a-4206-9c0f-6e34b78b1734Cited by top-tier papers7
- Unexpected Improvements to Expected Improvement for Bayesian OptimizationSebastian Ament, Samuel Daulton, David Eriksson, Maximilian Balandat et al.NeurIPS 2023 · 280 citations
- Pareto Set Learning for Expensive Multi-Objective OptimizationXi Lin, Zhiyuan Yang, Xiaoyuan Zhang, Qingfu ZhangNeurIPS 2022 · 119 citations
- Joint Entropy Search for Multi-Objective Bayesian OptimizationBen Tu, Axel Gandy, Nikolas Kantas, Behrang ShafeiNeurIPS 2022 · 75 citations
- Bayesian Optimization over Discrete and Mixed Spaces via Probabilistic ReparameterizationSamuel Daulton, Xingchen Wan, David Eriksson, Maximilian Balandat et al.NeurIPS 2022 · 71 citations
- Contextual Gaussian Process Bandits with Neural NetworksHaoting Zhang, Jinghai He, Rhonda Righter, Zuo-Jun Max Shen et al.NeurIPS 2023 · 8 citations
Builds on9
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian OptimizationSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2020 · 428 citations
- Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume ImprovementSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2021 · 276 citations
- Efficiently sampling functions from Gaussian process posteriorsJames T. Wilson, Viacheslav Borovitskiy, Alexander Terenin, Peter Mostowsky et al.ICML 2020 · 186 citations
- Diversity-Guided Multi-Objective Bayesian Optimization With Batch EvaluationsMina Konakovic-Lukovic, Yunsheng Tian, Wojciech MatusikNeurIPS 2020 · 114 citations
Related papers
- Bayesian Optimization of Risk MeasuresSait Cakmak, Raul Astudillo, Peter I. Frazier, Enlu ZhouNeurIPS 2020 · 65 citations
- Meta-VBO: Utilizing Prior Tasks in Optimizing Risk Measures with Gaussian ProcessesQuoc Phong Nguyen, Bryan Kian Hsiang Low, Patrick JailletICLR 2024 · 2 citations
- Risk-averse Heteroscedastic Bayesian OptimizationAnastasia Makarova, Ilnura Usmanova, Ilija Bogunovic, Andreas KrauseNeurIPS 2021 · 47 citations
- Optimizing Conditional Value-At-Risk of Black-Box FunctionsQuoc Phong Nguyen, Zhongxiang Dai, Bryan Kian Hsiang Low, Patrick JailletNeurIPS 2021 · 25 citations
- A Unified Framework for Bayesian Optimization under Contextual UncertaintySebastian Shenghong Tay, Chuan-Sheng Foo, Daisuke Urano, Richalynn Leong et al.ICLR 2024
