Categorical Flow Maps
Daan Roos, Oscar Davis, Floor Eijkelboom, Michael Bronstein, Max Welling, Ismail Ceylan, Luca Ambrogioni, Jan-Willem van de Meent
Abstract
We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated inference in diffusion and flow-based models, we define a flow map towards the simplex that transports probability mass toward a predicted endpoint, yielding a parametrisation that naturally constrains model predictions. Since our trajectories are continuous rather than discrete, Categorical Flow Maps can be trained with existing distillation techniques, as well as a new objective based on endpoint consistency. This continuous formulation also automatically unlocks test-time inference: we can directly reuse existing guidance and reweighting techniques in the categorical setting to steer sampling toward downstream objectives. Empirically, we achieve state-of-the-art few-step results on images, molecular graphs, and text, with strong performance even in single-step generation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bb8fdaa3-2ee2-4bfc-8300-0c371efded09Builds on44
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow et al.NeurIPS 2021 · 2,256 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang et al.NeurIPS 2025 · 949 citations
- Simple and Effective Masked Diffusion Language ModelsSubham S. Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan et al.NeurIPS 2024 · 929 citations
Related papers
- Align Your Flow: Scaling Continuous-Time Flow Map DistillationAmirmojtaba Sabour, Sanja Fidler, Karsten KreisNeurIPS 2025 · 91 citations
- Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Image GenerationQuan Dao, Hao Phung, Trung Tuan Dao, Dimitris N. Metaxas et al.AAAI 2025 · 11 citations
- Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free LunchXu Cai, Yang Wu, Qianli Chen, Haoran Wu et al.NeurIPS 2025 · 4 citations
- Generalised Flow Maps for Few-Step Generative Modelling on Riemannian ManifoldsOscar Davis, Michael S. Albergo, Nicholas M. Boffi, Michael M. Bronstein et al.ICLR 2026 · 12 citations
- Dirichlet Flow Matching with Applications to DNA Sequence DesignHannes Stärk, Bowen Jing, Chenyu Wang, Gabriele Corso et al.ICML 2024 · 110 citations
