Minimum Distance Summaries for Robust Neural Posterior Estimation
Sherman Khoo, Dennis Prangle, Song Liu, Mark Beaumont
Abstract
Simulation-based inference (SBI) enables amortized Bayesian inference by first training a neural posterior estimator (NPE) on prior-simulator pairs, typically through low-dimensional summary statistics, which can then be cheaply reused for fast inference by querying it on new test observations. Because NPE is estimated under the training data distribution, it is susceptible to misspecification when observations deviate from the training distribution. Many robust SBI approaches address this by modifying NPE training or introducing error models, coupling robustness to the inference network and compromising amortization and modularity. We introduce minimum-distance summaries, a post-hoc robust NPE method that adapts queried test-time summaries independently of the pretrained NPE. Leveraging the maximum mean discrepancy (MMD) as a distance between observed data and a summary-conditional predictive distribution, the adapted summary displays strong robustness properties due to the robustness of the MMD. We demonstrate that the algorithm can be implemented efficiently with random Fourier feature approximations, yielding a lightweight, model-free test-time adaptation procedure. We provide theoretical guarantees for the robustness of our algorithm and empirically evaluate it on a range of synthetic and real-world tasks, demonstrating substantial robustness gains compared with existing robust SBI methods with minimal additional overhead.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 30af7d29-bd21-4e58-8883-52e632a6f50bBuilds on8
- Likelihood-free MCMC with Amortized Approximate Ratio EstimatorsJoeri Hermans, Volodimir Begy, Gilles LouppeICML 2020 · 246 citations
- Robust Neural Posterior Estimation and Statistical Model CriticismDaniel Ward, Patrick Cannon, Mark Beaumont, Matteo Fasiolo et al.NeurIPS 2022 · 79 citations
- All-in-one simulation-based inferenceManuel Glöckler, Michael Deistler, Christian Dietrich Weilbach, Frank Wood et al.ICML 2024 · 74 citations
- Learning Robust Statistics for Simulation-based Inference under Model MisspecificationDaolang Huang, Ayush Bharti, Amauri H. Souza, Luigi Acerbi et al.NeurIPS 2023 · 69 citations
- Neural Approximate Sufficient Statistics for Implicit ModelsYanzhi Chen, Dinghuai Zhang, Michael U. Gutmann, Aaron C. Courville et al.ICLR 2021 · 21 citations
Related papers
- Adversarial robustness of amortized Bayesian inferenceManuel Glöckler, Michael Deistler, Jakob H. MackeICML 2023 · 23 citations
- Generalized Bayesian Inference for Scientific Simulators via Amortized Cost EstimationRichard Gao, Michael Deistler, Jakob H. MackeNeurIPS 2023 · 19 citations
- Optimally-weighted Estimators of the Maximum Mean Discrepancy for Likelihood-Free InferenceAyush Bharti, Masha Naslidnyk, Oscar Key, Samuel Kaski et al.ICML 2023 · 16 citations
- Flow Matching Calibration for Simulation-Based Inference under Model MisspecificationPierre-Louis Ruhlmann, Michael Arbel, Florence Forbes, Pedro Luiz Coelho RodriguesICML 2026 · 2 citations
- Truncated Marginal Neural Ratio EstimationBenjamin Kurt Miller, Alex Cole, Patrick Forré, Gilles Louppe et al.NeurIPS 2021 · 53 citations
