Minimum Distance Summaries for Robust Neural Posterior Estimation
Sherman Khoo, Dennis Prangle, Song Liu, Mark Beaumont
摘要
Simulation-based inference (SBI) enables amortized Bayesian inference by first training a neural posterior estimator (NPE) on prior-simulator pairs, typically through low-dimensional summary statistics, which can then be cheaply reused for fast inference by querying it on new test observations. Because NPE is estimated under the training data distribution, it is susceptible to misspecification when observations deviate from the training distribution. Many robust SBI approaches address this by modifying NPE training or introducing error models, coupling robustness to the inference network and compromising amortization and modularity. We introduce minimum-distance summaries, a post-hoc robust NPE method that adapts queried test-time summaries independently of the pretrained NPE. Leveraging the maximum mean discrepancy (MMD) as a distance between observed data and a summary-conditional predictive distribution, the adapted summary displays strong robustness properties due to the robustness of the MMD. We demonstrate that the algorithm can be implemented efficiently with random Fourier feature approximations, yielding a lightweight, model-free test-time adaptation procedure. We provide theoretical guarantees for the robustness of our algorithm and empirically evaluate it on a range of synthetic and real-world tasks, demonstrating substantial robustness gains compared with existing robust SBI methods with minimal additional overhead.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Likelihood-free MCMC with Amortized Approximate Ratio EstimatorsJoeri Hermans, Volodimir Begy, Gilles LouppeICML 2020 · 被引用 246 次
- Robust Neural Posterior Estimation and Statistical Model CriticismDaniel Ward, Patrick Cannon, Mark Beaumont, Matteo Fasiolo 等NeurIPS 2022 · 被引用 79 次
- All-in-one simulation-based inferenceManuel Glöckler, Michael Deistler, Christian Dietrich Weilbach, Frank Wood 等ICML 2024 · 被引用 74 次
- Learning Robust Statistics for Simulation-based Inference under Model MisspecificationDaolang Huang, Ayush Bharti, Amauri H. Souza, Luigi Acerbi 等NeurIPS 2023 · 被引用 69 次
- Neural Approximate Sufficient Statistics for Implicit ModelsYanzhi Chen, Dinghuai Zhang, Michael U. Gutmann, Aaron C. Courville 等ICLR 2021 · 被引用 21 次
相关 Paper
- Adversarial robustness of amortized Bayesian inferenceManuel Glöckler, Michael Deistler, Jakob H. MackeICML 2023 · 被引用 23 次
- Generalized Bayesian Inference for Scientific Simulators via Amortized Cost EstimationRichard Gao, Michael Deistler, Jakob H. MackeNeurIPS 2023 · 被引用 19 次
- Optimally-weighted Estimators of the Maximum Mean Discrepancy for Likelihood-Free InferenceAyush Bharti, Masha Naslidnyk, Oscar Key, Samuel Kaski 等ICML 2023 · 被引用 16 次
- Flow Matching Calibration for Simulation-Based Inference under Model MisspecificationPierre-Louis Ruhlmann, Michael Arbel, Florence Forbes, Pedro Luiz Coelho RodriguesICML 2026 · 被引用 2 次
- Truncated Marginal Neural Ratio EstimationBenjamin Kurt Miller, Alex Cole, Patrick Forré, Gilles Louppe 等NeurIPS 2021 · 被引用 53 次
