Accelerated Gamut Discovery via Massive Parallelization
Navid Ansari, Hans-Peter Seidel, Vahid Babaei
Abstract
a) Random (b) NSGA-II (c) LBN-MOBO (ours) Fig. 1.
We propose a highly accelerated approach for discovering the gamut of different design processes. Our method is capable of taking and proposing an extremely large batch of samples at each of its iterations while exploring the design space. In this teaser, we compare the performance of random sampling, NSGA-II (a stochastic multi-objective optimization), and our LBN-MOBO method in identifying the reachable space of a soft robot's tip. All methods operate under the same computational budget of 4 iterations, each with a batch size of 1,000 samples. Our method significantly outperforms existing approaches in both coverage and efficiency.
This paper presents a scalable framework for efficiently discovering the performance gamut of different processes. Gamut boundaries comprise the set of highest-performing solutions within a design space. While sampling methods are often inefficient or prone to premature convergence, Bayesian optimization struggles with taking advantage of existing large-scale parallel computation or experimentation. To address these challenges, we utilize Bayesian neural networks as scalable surrogates for performance prediction and uncertainty estimation. We further introduce a novel acquisition function that combines the diversity-driven exploration of stochastic optimization with the information-efficient exploitation of Bayesian optimization. This enables generating large, high-quality batches of samples. Our approach leverages large batch sizes to reduce the number of iterations needed for optimization. We demonstrate its effectiveness on real-world engineering and robotic problems, achieving faster and more extensive discovery of the performance gamut. Code and data are available at https://gitlab.mpi-klsb.mpg.de/nansari/lbn_mobo.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume ImprovementSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2021 · 276 citations
- Diversity-Guided Multi-Objective Bayesian Optimization With Batch EvaluationsMina Konakovic-Lukovic, Yunsheng Tian, Wojciech MatusikNeurIPS 2020 · 114 citations
- Amortized Finite Element Analysis for Fast PDE-Constrained OptimizationTianju Xue, Alex Beatson, Sigrid Adriaenssens, Ryan P. AdamsICML 2020 · 35 citations
- Autoinverse: Uncertainty Aware Inversion of Neural NetworksNavid Ansari, Hans-Peter Seidel, Nima Vahidi Ferdowsi, Vahid BabaeiNeurIPS 2022 · 18 citations
- Amortized Synthesis of Constrained Configurations Using a Differentiable SurrogateXingyuan Sun, Tianju Xue, Szymon Rusinkiewicz, Ryan P. AdamsNeurIPS 2021 · 14 citations
Related papers
- Batched Energy-Entropy acquisition for Bayesian OptimizationFelix Teufel, Carsten Stahlhut, Jesper Ferkinghoff-BorgNeurIPS 2024 · 3 citations
- Bayesian Optimization over Permutation SpacesAryan Deshwal, Syrine Belakaria, Janardhan Rao Doppa, Dae Hyun KimAAAI 2022 · 27 citations
- Pareto Front-Diverse Batch Multi-Objective Bayesian OptimizationAlaleh Ahmadianshalchi, Syrine Belakaria, Janardhan Rao DoppaAAAI 2024 · 16 citations
- Probability of Matching for Batch Multi-Objective Bayesian OptimizationMingqian Li, Sina Zadeh, Raymundo Arroyave, Xiaoning QianICML 2026
- BOtied: Multi-objective Bayesian optimization with tied multivariate ranksJi Won Park, Natasa Tagasovska, Michael Maser, Stephen Ra et al.ICML 2024 · 17 citations
