Categorical Flow Maps
Daan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein, Max Welling, Ismail Ceylan, Luca Ambrogioni, Jan-Willem van de Meent
摘要
We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper44
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow 等NeurIPS 2021 · 被引用 2,256 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang 等NeurIPS 2025 · 被引用 949 次
- Simple and Effective Masked Diffusion Language ModelsSubham S. Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan 等NeurIPS 2024 · 被引用 929 次
相关 Paper
- Align Your Flow: Scaling Continuous-Time Flow Map DistillationAmirmojtaba Sabour, Sanja Fidler, Karsten KreisNeurIPS 2025 · 被引用 91 次
- Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Image GenerationQuan Dao, Hao Phung, Trung Tuan Dao, Dimitris N. Metaxas 等AAAI 2025 · 被引用 11 次
- Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free LunchXu Cai, Yang Wu, Qianli Chen, Haoran Wu 等NeurIPS 2025 · 被引用 4 次
- Generalised Flow Maps for Few-Step Generative Modelling on Riemannian ManifoldsOscar Davis, Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein 等ICLR 2026 · 被引用 12 次
- Dirichlet Flow Matching with Applications to DNA Sequence DesignHannes Stärk, Bowen Jing, Chenyu Wang, Gabriele Corso 等ICML 2024 · 被引用 110 次
