Riemannian Score-Based Generative Modelling
Valentin De Bortoli, Emile Mathieu, Michael J. Hutchinson, James Thornton, Yee Whye Teh, Arnaud Doucet
Abstract
Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a noising'' stage, whereby a diffusion is used to gradually add Gaussian noise to data, and a generative model, which entails a denoising'' process defined by approximating the time-reversal of the diffusion. Existing SGMs assume that data is supported on a Euclidean space, i.e. a manifold with flat geometry. In many domains such as robotics, geoscience or protein modelling, data is often naturally described by distributions living on Riemannian manifolds and current SGM techniques are not appropriate. We introduce here Riemannian Score-based Generative Models (RSGMs), a class of generative models extending SGMs to Riemannian manifolds. We demonstrate our approach on a variety of manifolds, and in particular with earth and climate science spherical data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 63bbf70f-1e13-4a72-8901-741b272469d9Cited by top-tier papers90
- Antigen-Specific Antibody Design and Optimization with Diffusion-Based Generative Models for Protein StructuresShitong Luo, Yufeng Su, Xingang Peng, Sheng Wang et al.NeurIPS 2022 · 331 citations
- Practical and Asymptotically Exact Conditional Sampling in Diffusion ModelsLuhuan Wu, Brian L. Trippe, Christian A. Naesseth, David M. Blei et al.NeurIPS 2023 · 276 citations
- Crystal Structure Prediction by Joint Equivariant DiffusionRui Jiao, Wenbing Huang, Peijia Lin, Jiaqi Han et al.NeurIPS 2023 · 245 citations
- SE(3)-Stochastic Flow Matching for Protein Backbone GenerationAvishek Joey Bose, Tara Akhound-Sadegh, Guillaume Huguet, Kilian Fatras et al.ICLR 2024 · 162 citations
- Diffusion Language Models Are Versatile Protein LearnersXinyou Wang, Zaixiang Zheng, Fei Ye, Dongyu Xue et al.ICML 2024 · 113 citations
Builds on16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative ModelingValentin De Bortoli, James Thornton, Jeremy Heng, Arnaud DoucetNeurIPS 2021 · 811 citations
Related papers
- Unified Framework for Diffusion Generative Models in SO(3): Applications in Computer Vision and AstrophysicsYesukhei Jagvaral, François Lanusse, Rachel MandelbaumAAAI 2024 · 10 citations
- Riemannian Diffusion ModelsChin-Wei Huang, Milad Aghajohari, Joey Bose, Prakash Panangaden et al.NeurIPS 2022 · 154 citations
- Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural NetworksGyeonghoon Ko, Juho LeeICML 2026 · 1 citation
- Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion ProcessesJaehyeong Jo, Sung Ju HwangICML 2024 · 19 citations
- Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function SingularityZichen Liu, Wei Zhang, Tiejun LiNeurIPS 2025 · 14 citations
