Scaling up Hybrid Probabilistic Inference with Logical and Arithmetic Constraints via Message Passing
Zhe Zeng, Paolo Morettin, Fanqi Yan, Antonio Vergari, Guy Van den Broeck
Abstract
Weighted model integration (WMI) is an appealing framework for probabilistic inference: it allows for expressing the complex dependencies in real-world problems, where variables are both continuous and discrete, via the language of Satisfiability Modulo Theories (SMT), as well as to compute probabilistic queries with complex logical and arithmetic constraints. Yet, existing WMI solvers are not ready to scale to these problems. They either ignore the intrinsic dependency structure of the problem entirely, or they are limited to overly restrictive structures. To narrow this gap, we derive a factorized WMI computation enabling us to devise a scalable WMI solver based on message passing, called MP-WMI. Namely, MP-WMI is the first WMI solver that can (i) perform exact inference on the full class of tree-structured WMI problems, and (ii) perform inter-query amortization, e.g., to compute all marginal densities simultaneously. Experimental results show that our solver dramatically outperforms the existing WMI solvers on a large set of benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0bb74ddb-30d0-4305-9fd1-74bf31ebeef8Cited by top-tier papers5
- A Compositional Atlas of Tractable Circuit Operations for Probabilistic InferenceAntonio Vergari, YooJung Choi, Anji Liu, Stefano Teso et al.NeurIPS 2021 · 112 citations
- A Unified Approach to Count-Based Weakly Supervised LearningVinay Shukla, Zhe Zeng, Kareem Ahmed, Guy Van den BroeckNeurIPS 2023 · 14 citations
- Probabilistic Inference with Algebraic Constraints: Theoretical Limits and Practical ApproximationsZhe Zeng, Paolo Morettin, Fanqi Yan, Antonio Vergari et al.NeurIPS 2020 · 13 citations
- Collapsed Inference for Bayesian Deep LearningZhe Zeng, Guy Van den BroeckNeurIPS 2023 · 10 citations
- The Theory and Practice of MAP Inference over Non-Convex ConstraintsLeander Kurscheidt, Gabriele Masina, Roberto Sebastiani, Antonio VergariICML 2026 · 1 citation
Builds on1
Related papers
- Solving Satisfiability Modulo Counting Exactly with Probabilistic CircuitsJinzhao Li, Nan Jiang, Yexiang XueICML 2025
- Verification of Multi-Model Stochastic SystemsRadu Calinescu, Simos Gerasimou, Sinem Getir Yaman, Gricel Vazquez et al.ICSE 2026 · 1 citation
- SPPL: probabilistic programming with fast exact symbolic inferenceFeras A. Saad, Martin C. Rinard, Vikash K. MansinghkaPLDI 2021 · 38 citations
- λPSI: exact inference for higher-order probabilistic programsTimon Gehr, Samuel Steffen, Martin T. VechevPLDI 2020 · 29 citations
- Scaling exact inference for discrete probabilistic programsSteven Holtzen, Guy Van den Broeck, Todd D. MillsteinOOPSLA 2020 · 85 citations
