Accelerated Gamut Discovery via Massive Parallelization
Navid Ansari, Hans-Peter Seidel, Vahid Babaei
摘要
a) Random (b) NSGA-II (c) LBN-MOBO (ours) Fig. 1.
We propose a highly accelerated approach for discovering the gamut of different design processes. Our method is capable of taking and proposing an extremely large batch of samples at each of its iterations while exploring the design space. In this teaser, we compare the performance of random sampling, NSGA-II (a stochastic multi-objective optimization), and our LBN-MOBO method in identifying the reachable space of a soft robot's tip. All methods operate under the same computational budget of 4 iterations, each with a batch size of 1,000 samples. Our method significantly outperforms existing approaches in both coverage and efficiency.
This paper presents a scalable framework for efficiently discovering the performance gamut of different processes. Gamut boundaries comprise the set of highest-performing solutions within a design space. While sampling methods are often inefficient or prone to premature convergence, Bayesian optimization struggles with taking advantage of existing large-scale parallel computation or experimentation. To address these challenges, we utilize Bayesian neural networks as scalable surrogates for performance prediction and uncertainty estimation. We further introduce a novel acquisition function that combines the diversity-driven exploration of stochastic optimization with the information-efficient exploitation of Bayesian optimization. This enables generating large, high-quality batches of samples. Our approach leverages large batch sizes to reduce the number of iterations needed for optimization. We demonstrate its effectiveness on real-world engineering and robotic problems, achieving faster and more extensive discovery of the performance gamut. Code and data are available at https://gitlab.mpi-klsb.mpg.de/nansari/lbn_mobo.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume ImprovementSamuel Daulton, Maximilian Balandat, Eytan BakshyNeurIPS 2021 · 被引用 276 次
- Diversity-Guided Multi-Objective Bayesian Optimization With Batch EvaluationsMina Konakovic-Lukovic, Yunsheng Tian, Wojciech MatusikNeurIPS 2020 · 被引用 114 次
- Amortized Finite Element Analysis for Fast PDE-Constrained OptimizationTianju Xue, Alex Beatson, Sigrid Adriaenssens, Ryan P. AdamsICML 2020 · 被引用 35 次
- Autoinverse: Uncertainty Aware Inversion of Neural NetworksNavid Ansari, Hans-Peter Seidel, Nima Vahidi Ferdowsi, Vahid BabaeiNeurIPS 2022 · 被引用 18 次
- Amortized Synthesis of Constrained Configurations Using a Differentiable SurrogateXingyuan Sun, Tianju Xue, Szymon Rusinkiewicz, Ryan P. AdamsNeurIPS 2021 · 被引用 14 次
相关 Paper
- Batched Energy-Entropy acquisition for Bayesian OptimizationFelix Teufel, Carsten Stahlhut, Jesper Ferkinghoff-BorgNeurIPS 2024 · 被引用 3 次
- Bayesian Optimization over Permutation SpacesAryan Deshwal, Syrine Belakaria, Janardhan Rao Doppa, Dae Hyun KimAAAI 2022 · 被引用 27 次
- Pareto Front-Diverse Batch Multi-Objective Bayesian OptimizationAlaleh Ahmadianshalchi, Syrine Belakaria, Janardhan Rao DoppaAAAI 2024 · 被引用 16 次
- Probability of Matching for Batch Multi-Objective Bayesian OptimizationMingqian Li, Sina Zadeh, Raymundo Arroyave, Xiaoning QianICML 2026
- BOtied: Multi-objective Bayesian optimization with tied multivariate ranksJi Won Park, Natasa Tagasovska, Michael Maser, Stephen Ra 等ICML 2024 · 被引用 17 次
