Scalable Simulation-Based Model Inference with Test-Time Complexity Control
Manuel Glöckler, Jose Pedro JP Manzano-Patron, Stamatios Sotiropoulos, Cornelius Schröder, Jakob Macke
Abstract
Simulation plays a central role in scientific discovery. In many applications, the bottleneck is no longer running a simulator—it is choosing among large families of plausible simulators, each corresponding to different forward models/hypotheses consistent with observations. Over large model families, classical Bayesian workflows for model-selection are impractical. Furthermore, amortized model-selection methods typically hard-code a fixed model prior—or complexity penalty—at training time, requiring users to commit to a particular parsimony assumption before seeing the data. We introduce PRISM, a simulation-based encoder-decoder that infers a joint posterior over both discrete model structures and associated continuous parameters, while enabling test-time control of model complexity via a tunable model prior that the network is conditioned on. We show that PRISM scales to families with combinatorially many (up to billions of) model instantiations on a synthetic symbolic regression task. As a scientific application, we evaluate PRISM on biophysical modeling for diffusion MRI data, showing the ability to perform model selection across several multi-compartment models, on both synthetic and in-vivo neuroimaging data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Discovering Symbolic Models from Deep Learning with Inductive BiasesMiles D. Cranmer, Alvaro Sanchez-Gonzalez, Peter W. Battaglia, Rui Xu et al.NeurIPS 2020 · 736 citations
- Neural Symbolic Regression that scalesLuca Biggio, Tommaso Bendinelli, Alexander Neitz, Aurélien Lucchi et al.ICML 2021 · 251 citations
- Bayesian Model Selection, the Marginal Likelihood, and GeneralizationSanae Lotfi, Pavel Izmailov, Gregory W. Benton, Micah Goldblum et al.ICML 2022 · 83 citations
Related papers
- Simultaneous identification of models and parameters of scientific simulatorsCornelius Schröder, Jakob H. MackeICML 2024 · 10 citations
- PriorGuide: Test-Time Prior Adaptation for Simulation-Based InferenceYang Yang, Severi Rissanen, Paul Edmund Chang, Nasrulloh Ratu Bagus Satrio Loka et al.ICLR 2026 · 3 citations
- All-in-one simulation-based inferenceManuel Glöckler, Michael Deistler, Christian Dietrich Weilbach, Frank Wood et al.ICML 2024 · 74 citations
- ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian ModelsLouis Rouillard, Demian WassermannICLR 2022 · 2 citations
- Multifidelity Simulation-based Inference for Computationally Expensive SimulatorsAnastasia Nastya Krouglova, Hayden R. Johnson, Basile Confavreux, Michael Deistler et al.ICLR 2026 · 17 citations
