Neurosymbolic Diffusion Models
Emile van Krieken, Pasquale Minervini, Edoardo Maria Ponti, Antonio Vergari
Abstract
Neurosymbolic (NeSy) predictors combine neural perception with symbolic reasoning to solve tasks like visual reasoning. However, standard NeSy predictors assume conditional independence between the symbols they extract, thus limiting their ability to model interactions and uncertainty - often leading to overconfident predictions and poor out-of-distribution generalisation. To overcome the limitations of the independence assumption, we introduce neurosymbolic diffusion models (NeSyDMs), a new class of NeSy predictors that use discrete diffusion to model dependencies between symbols. Our approach reuses the independence assumption from NeSy predictors at each step of the diffusion process, enabling scalable learning while capturing symbol dependencies and uncertainty quantification. Across both synthetic and real-world benchmarks - including high-dimensional visual path planning and rule-based autonomous driving - NeSyDMs achieve state-of-the-art accuracy among NeSy predictors and demonstrate strong calibration.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f003e945-1e7b-4d49-8903-dd859c01629fCited by top-tier papers6
- LaDiR: Latent Diffusion Enhances LLMs for Text ReasoningHaoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Nicklas Majamaki et al.ICLR 2026 · 25 citations
- Right for the Right Reasons: Avoiding Reasoning Shortcuts via Prototypical Neurosymbolic AILuca Andolfi, Eleonora GiunchigliaNeurIPS 2025 · 4 citations
- Learning to Disentangle Latent Reasoning Rules with Language VAEs: A Systematic StudyYingji Zhang, Marco Valentino, Danilo S. Carvalho, André FreitasAAAI 2026 · 1 citation
- The Theory and Practice of MAP Inference over Non-Convex ConstraintsLeander Kurscheidt, Gabriele Masina, Roberto Sebastiani, Antonio VergariICML 2026 · 1 citation
- Can I Have Your Order? Monte-Carlo Tree Search for Slot Filling Ordering in Diffusion Language ModelsJoshua Ong, Yu Zhao, Mihaela C. Stoian, Wenda Li et al.ICML 2026
Builds on38
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow et al.NeurIPS 2021 · 2,256 citations
- On the Variance of the Adaptive Learning Rate and BeyondLiyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen et al.ICLR 2020 · 2,210 citations
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang et al.NeurIPS 2025 · 949 citations
- Simple and Effective Masked Diffusion Language ModelsSubham S. Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan et al.NeurIPS 2024 · 929 citations
- Simplified and Generalized Masked Diffusion for Discrete DataJiaxin Shi, Kehang Han, Zhe Wang, Arnaud Doucet et al.NeurIPS 2024 · 693 citations
Related papers
- Relational Neurosymbolic Markov ModelsLennert De Smet, Gabriele Venturato, Luc De Raedt, Giuseppe MarraAAAI 2025 · 3 citations
- Constraints-Guided Diffusion Reasoner for Neuro-Symbolic LearningXuan Zhang, Zhijian Zhou, Weidi Xu, Yanting Miao et al.AAAI 2026
- On the Independence Assumption in Neurosymbolic LearningEmile van Krieken, Pasquale Minervini, Edoardo M. Ponti, Antonio VergariICML 2024 · 18 citations
- Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning ShortcutsEmanuele Marconato, Stefano Teso, Antonio Vergari, Andrea PasseriniNeurIPS 2023 · 83 citations
- NePTune: A Neuro-Pythonic Framework for Tunable Compositional Reasoning on Vision-LanguageDanial Kamali, Parisa KordjamshidiICLR 2026 · 10 citations
