Entering the Era of Discrete Diffusion Models: A Benchmark for Schrödinger Bridges and Entropic Optimal Transport
Xavier Aramayo Carrasco, Grigoriy Ksenofontov, Aleksei Leonov, Iaroslav Koshelev, Aleksandr Korotin
摘要
The Entropic Optimal Transport (EOT) problem and its dynamic counterpart, the Schrödinger bridge (SB) problem, play an important role in modern machine learning, linking generative modeling with optimal transport theory. While recent advances in discrete diffusion and flow models have sparked growing interest in applying SB methods to discrete domains, there remains no reliable way to assess how well these methods actually solve the underlying problem. We address this challenge by introducing a benchmark for SB on discrete spaces. Our construction yields pairs of probability distributions with analytically known SB solutions, enabling rigorous evaluation. As a byproduct of building this benchmark, we obtain two new SB algorithms, DLightSB and DLightSB-M, and additionally extend prior related work to construct the -CSBM algorithm. We demonstrate the utility of our benchmark by evaluating both existing and new solvers in high-dimensional discrete settings. This work provides the first step toward proper evaluation of SB methods on discrete spaces, paving the way for more reproducible future studies. The code for the benchmark and all associated experiments is available at this repository.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Learning of Population Dynamics: Inverse Optimization Meets JKO SchemeMikhail Persiianov, Jiawei Chen, Petr Mokrov, Alexander Tyurin 等ICLR 2026 · 被引用 7 次
- InfoBridge: Mutual Information estimation via Bridge MatchingSergei Kholkin, Ivan Butakov, Evgeny Burnaev, Nikita Gushchin 等ICLR 2026 · 被引用 7 次
它引用的顶会 Paper24
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow 等NeurIPS 2021 · 被引用 2,256 次
- Simple and Effective Masked Diffusion Language ModelsSubham S. Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan 等NeurIPS 2024 · 被引用 929 次
- Argmax Flows and Multinomial Diffusion: Learning Categorical DistributionsEmiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré 等NeurIPS 2021 · 被引用 782 次
- A Continuous Time Framework for Discrete Denoising ModelsAndrew Campbell, Joe Benton, Valentin De Bortoli, Thomas Rainforth 等NeurIPS 2022 · 被引用 496 次
- Discrete Flow MatchingItai Gat, Tal Remez, Neta Shaul, Felix Kreuk 等NeurIPS 2024 · 被引用 363 次
相关 Paper
- Schrodinger Bridge Flow for Unpaired Data TranslationValentin De Bortoli, Iryna Korshunova, Andriy Mnih, Arnaud DoucetNeurIPS 2024 · 被引用 55 次
- Diffusion Schrödinger Bridge MatchingYuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud DoucetNeurIPS 2023 · 被引用 178 次
- Light and Optimal Schrödinger Bridge MatchingNikita Gushchin, Sergei Kholkin, Evgeny Burnaev, Alexander KorotinICML 2024 · 被引用 39 次
- Discrete Diffusion Schrödinger Bridge Matching for Graph TransformationJun Hyeong Kim, Seonghwan Kim, Seokhyun Moon, Hyeongwoo Kim 等ICLR 2025
- Entropic Neural Optimal Transport via Diffusion ProcessesNikita Gushchin, Alexander Kolesov, Alexander Korotin, Dmitry P. Vetrov 等NeurIPS 2023 · 被引用 59 次
