Diffusion Schrödinger Bridge Matching
Yuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud Doucet
摘要
Solving transport problems, i.e. finding a map transporting one given distribution to another, has numerous applications in machine learning. Novel mass transport methods motivated by generative modeling have recently been proposed, e.g. Denoising Diffusion Models (DDMs) and Flow Matching Models (FMMs) implement such a transport through a Stochastic Differential Equation (SDE) or an Ordinary Differential Equation (ODE). However, while it is desirable in many applications to approximate the deterministic dynamic Optimal Transport (OT) map which admits attractive properties, DDMs and FMMs are not guaranteed to provide transports close to the OT map. In contrast, Schrödinger bridges (SBs) compute stochastic dynamic mappings which recover entropy-regularized versions of OT. Unfortunately, existing numerical methods approximating SBs either scale poorly with dimension or accumulate errors across iterations. In this work, we introduce Iterative Markovian Fitting (IMF), a new methodology for solving SB problems, and Diffusion Schrödinger Bridge Matching (DSBM), a novel numerical algorithm for computing IMF iterates. DSBM significantly improves over previous SB numerics and recovers as special/limiting cases various recent transport methods. We demonstrate the performance of DSBM on a variety of problems.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper141
- SE(3)-Stochastic Flow Matching for Protein Backbone GenerationAvishek Joey Bose, Tara Akhound-Sadegh, Guillaume Huguet, Kilian Fatras 等ICLR 2024 · 被引用 162 次
- Unpaired Image-to-Image Translation via Neural Schrödinger BridgeBeomsu Kim, Gihyun Kwon, Kwanyoung Kim, Jong Chul YeICLR 2024 · 被引用 131 次
- Optimal Flow Matching: Learning Straight Trajectories in Just One StepNikita Kornilov, Petr Mokrov, Alexander V. Gasnikov, Alexander KorotinNeurIPS 2024 · 被引用 93 次
- Metric Flow Matching for Smooth Interpolations on the Data ManifoldKacper Kapusniak, Peter Potaptchik, Teodora Reu, Leo Zhang 等NeurIPS 2024 · 被引用 89 次
- On the Generalization Properties of Diffusion ModelsPuheng Li, Zhong Li, Huishuai Zhang, Jiang BianNeurIPS 2023 · 被引用 86 次
它引用的顶会 Paper17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song 等ICLR 2022 · 被引用 2,128 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Diffusion Schrödinger Bridge with Applications to Score-Based Generative ModelingValentin De Bortoli, James Thornton, Jeremy Heng, Arnaud DoucetNeurIPS 2021 · 被引用 811 次
相关 Paper
- Schrodinger Bridge Flow for Unpaired Data TranslationValentin De Bortoli, Iryna Korshunova, Andriy Mnih, Arnaud DoucetNeurIPS 2024 · 被引用 55 次
- Schrödinger Bridge Matching for Tree-Structured Costs and Entropic Wasserstein BarycentresSamuel Howard, Peter Potaptchik, George DeligiannidisNeurIPS 2025 · 被引用 4 次
- Discrete Diffusion Schrödinger Bridge Matching for Graph TransformationJun Hyeong Kim, Seonghwan Kim, Seokhyun Moon, Hyeongwoo Kim 等ICLR 2025
- Adversarial Schrödinger Bridge MatchingNikita Gushchin, Daniil Selikhanovych, Sergei Kholkin, Evgeny Burnaev 等NeurIPS 2024 · 被引用 14 次
- Light and Optimal Schrödinger Bridge MatchingNikita Gushchin, Sergei Kholkin, Evgeny Burnaev, Alexander KorotinICML 2024 · 被引用 39 次
