Unifying Likelihood-free Inference with Black-box Optimization and Beyond
Dinghuai Zhang, Jie Fu, Yoshua Bengio, Aaron C. Courville
Abstract
Black-box optimization formulations for biological sequence design have drawn recent attention due to their promising potential impact on the pharmaceutical industry. In this work, we propose to unify two seemingly distinct worlds: likelihood-free inference and black-box optimization, under one probabilistic framework. In tandem, we provide a recipe for constructing various sequence design methods based on this framework. We show how previous optimization approaches can be "reinvented" in our framework, and further propose new probabilistic black-box optimization algorithms. Extensive experiments on sequence design application illustrate the benefits of the proposed methodology.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b0b976e7-ddcd-4488-b5c7-878b729045b9Cited by top-tier papers7
- Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimizationDinghuai Zhang, Ricky T. Q. Chen, Cheng-Hao Liu, Aaron C. Courville et al.ICLR 2024 · 64 citations
- Bidirectional Learning for Offline Infinite-width Model-based OptimizationCan Chen, Yingxue Zhang, Jie Fu, Xue (Steve) Liu et al.NeurIPS 2022 · 56 citations
- Pre-Training and Fine-Tuning Generative Flow NetworksLing Pan, Moksh Jain, Kanika Madan, Yoshua BengioICLR 2024 · 24 citations
- GFlowNet Assisted Biological Sequence EditingPouya M. Ghari, Alex M. Tseng, Gökcen Eraslan, Romain Lopez et al.NeurIPS 2024 · 10 citations
- ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type NeighborhoodsMichal Kmicikiewicz, Vincent Fortuin, Ewa SzczurekNeurIPS 2025 · 4 citations
Builds on7
- GraphAF: a Flow-based Autoregressive Model for Molecular Graph GenerationChence Shi, Minkai Xu, Zhaocheng Zhu, Weinan Zhang et al.ICLR 2020 · 532 citations
- Model-based reinforcement learning for biological sequence designChristof Angermüller, David Dohan, David Belanger, Ramya Deshpande et al.ICLR 2020 · 159 citations
- Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical SpaceAkshatKumar Nigam, Pascal Friederich, Mario Krenn, Alán Aspuru-GuzikICLR 2020 · 154 citations
- Population-Based Black-Box Optimization for Biological Sequence DesignChristof Angermüller, David Belanger, Andreea Gane, Zelda Mariet et al.ICML 2020 · 142 citations
- Learning to Navigate The Synthetically Accessible Chemical Space Using Reinforcement LearningSai Krishna Gottipati, Boris Sattarov, Sufeng Niu, Yashaswi Pathak et al.ICML 2020 · 127 citations
Related papers
- Bootstrapped Training of Score-Conditioned Generator for Offline Design of Biological SequencesMinsu Kim, Federico Berto, Sungsoo Ahn, Jinkyoo ParkNeurIPS 2023 · 30 citations
- A General Recipe for Likelihood-free Bayesian OptimizationJiaming Song, Lantao Yu, Willie Neiswanger, Stefano ErmonICML 2022 · 29 citations
- Variational Search DistributionsDaniel M. Steinberg, Rafael Oliveira, Cheng Soon Ong, Edwin V. BonillaICLR 2025
- Accelerating Bayesian Optimization for Biological Sequence Design with Denoising AutoencodersSamuel Stanton, Wesley J. Maddox, Nate Gruver, Phillip M. Maffettone et al.ICML 2022 · 137 citations
- Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted RetrainingAustin Tripp, Erik A. Daxberger, José Miguel Hernández-LobatoNeurIPS 2020 · 186 citations
