GATSBI: Generative Adversarial Training for Simulation-Based Inference
Poornima Ramesh, Jan-Matthis Lueckmann, Jan Boelts, Álvaro Tejero-Cantero, David S. Greenberg, Pedro J. Gonçalves, Jakob H. Macke
Abstract
Simulation-based inference (SBI) refers to statistical inference on stochastic models for which we can generate samples, but not compute likelihoods. Like SBI algorithms, generative adversarial networks (GANs) do not require explicit likelihoods. We study the relationship between SBI and GANs, and introduce GATSBI, an adversarial approach to SBI. GATSBI reformulates the variational objective in an adversarial setting to learn implicit posterior distributions. Inference with GATSBI is amortised across observations, works in high-dimensional posterior spaces and supports implicit priors. We evaluate GATSBI on two SBI benchmark problems and on two high-dimensional simulators. On a model for wave propagation on the surface of a shallow water body, we show that GATSBI can return well-calibrated posterior estimates even in high dimensions. On a model of camera optics, it infers a high-dimensional posterior given an implicit prior, and performs better than a state-of-the-art SBI approach. We also show how GATSBI can be extended to perform sequential posterior estimation to focus on individual observations. Overall, GATSBI opens up opportunities for leveraging advances in GANs to perform Bayesian inference on high-dimensional simulation-based models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers14
- Truncated proposals for scalable and hassle-free simulation-based inferenceMichael Deistler, Pedro J. Gonçalves, Jakob H. MackeNeurIPS 2022 · 76 citations
- All-in-one simulation-based inferenceManuel Glöckler, Michael Deistler, Christian Dietrich Weilbach, Frank Wood et al.ICML 2024 · 74 citations
- Learning Robust Statistics for Simulation-based Inference under Model MisspecificationDaolang Huang, Ayush Bharti, Amauri H. Souza, Luigi Acerbi et al.NeurIPS 2023 · 69 citations
- Sampling-Based Accuracy Testing of Posterior Estimators for General InferencePablo Lemos, Adam Coogan, Yashar Hezaveh, Laurence Perreault LevasseurICML 2023 · 66 citations
- Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion ModelsLouis Sharrock, Jack Simons, Song Liu, Mark BeaumontICML 2024 · 56 citations
Builds on2
Related papers
- Deep Variational Implicit ProcessesLuis A. Ortega, Simón Rodríguez Santana, Daniel Hernández-LobatoICLR 2023 · 15 citations
- Generalized Bayesian Inference for Scientific Simulators via Amortized Cost EstimationRichard Gao, Michael Deistler, Jakob H. MackeNeurIPS 2023 · 19 citations
- Function-space Inference with Sparse Implicit ProcessesSimón Rodríguez Santana, Bryan Zaldivar, Daniel Hernández-LobatoICML 2022 · 13 citations
- Calibrating Neural Simulation-Based Inference with Differentiable Coverage ProbabilityMaciej Falkiewicz, Naoya Takeishi, Imahn Shekhzadeh, Antoine Wehenkel et al.NeurIPS 2023 · 15 citations
- Adversarial robustness of amortized Bayesian inferenceManuel Glöckler, Michael Deistler, Jakob H. MackeICML 2023 · 23 citations
