Robust Simulation-Based Inference under Missing Data via Neural Processes
Yogesh Verma, Ayush Bharti, Vikas Garg
Abstract
Simulation-based inference (SBI) methods typically require fully observed data to infer parameters of models with intractable likelihood functions. However, datasets often contain missing values due to incomplete observations, data corruptions (common in astrophysics), or instrument limitations (e.g., in high-energy physics applications). In such scenarios, missing data must be imputed before applying any SBI method. We formalize the problem of missing data in SBI and demonstrate that naive imputation methods can introduce bias in the estimation of SBI posterior. We also introduce a novel amortized method that addresses this issue by jointly learning the imputation model and the inference network within a neural posterior estimation (NPE) framework. Extensive empirical results on SBI benchmarks show that our approach provides robust inference outcomes compared to standard baselines for varying levels of missing data. Moreover, we demonstrate the merits of our imputation model on two real-world bioactivity datasets (Adrenergic and Kinase assays). Code is available at https://github.com/Aalto-QuML/RISE .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- Missing Data Imputation using Optimal TransportBoris Muzellec, Julie Josse, Claire Boyer, Marco CuturiICML 2020 · 179 citations
- Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural ProcessesAndrew Y. K. Foong, Wessel P. Bruinsma, Jonathan Gordon, Yann Dubois et al.NeurIPS 2020 · 96 citations
- not-MIWAE: Deep Generative Modelling with Missing not at Random DataNiels Bruun Ipsen, Pierre-Alexandre Mattei, Jes FrellsenICLR 2021 · 81 citations
- Robust Neural Posterior Estimation and Statistical Model CriticismDaniel Ward, Patrick Cannon, Mark Beaumont, Matteo Fasiolo et al.NeurIPS 2022 · 79 citations
- All-in-one simulation-based inferenceManuel Glöckler, Michael Deistler, Christian Dietrich Weilbach, Frank Wood et al.ICML 2024 · 74 citations
Related papers
- Generalized Bayesian Inference for Scientific Simulators via Amortized Cost EstimationRichard Gao, Michael Deistler, Jakob H. MackeNeurIPS 2023 · 19 citations
- Learning Robust Statistics for Simulation-based Inference under Model MisspecificationDaolang Huang, Ayush Bharti, Amauri H. Souza, Luigi Acerbi et al.NeurIPS 2023 · 69 citations
- Adversarial robustness of amortized Bayesian inferenceManuel Glöckler, Michael Deistler, Jakob H. MackeICML 2023 · 23 citations
- Calibrating Neural Simulation-Based Inference with Differentiable Coverage ProbabilityMaciej Falkiewicz, Naoya Takeishi, Imahn Shekhzadeh, Antoine Wehenkel et al.NeurIPS 2023 · 15 citations
- Compositional simulation-based inference for time seriesManuel Glöckler, Shoji Toyota, Kenji Fukumizu, Jakob H. MackeICLR 2025
