FACM: Flow-Anchored Consistency Models
Yansong Peng, Kai Zhu, Yu Liu, Pingyu Wu, Hebei Li, Xiaoyan Sun, Feng Wu
Abstract
Continuous-time Consistency Models (CMs) promise efficient few-step generation but face significant challenges with training instability. We argue this instability stems from a fundamental conflict: Training the network exclusively on a shortcut objective leads to the catastrophic forgetting of the instantaneous velocity field that defines the flow. Our solution is to explicitly anchor the model in the underlying flow, ensuring high trajectory fidelity during training. We introduce the Flow-Anchored Consistency Model (FACM), where a Flow Matching (FM) task serves as a dynamic anchor for the primary CM shortcut objective. Key to this Flow-Anchoring approach is a novel expanded time interval strategy that unifies optimization for a single model while decoupling the two tasks to ensure stable, architecturally-agnostic training. By distilling a pre-trained LightningDiT model, our method achieves a state-of-the-art FID of 1.32 with two steps (NFE=2) and 1.70 with just one step (NFE=1) on ImageNet 256256. To address the challenge of scalability, we develop a memory-efficient Chain-JVP that resolves key incompatibilities with FSDP. This method allows us to scale FACM training on a 14B parameter model (Wan 2.2), accelerating its Text-to-Image inference from 240 to 2-8 steps. Our code and pretrained models: https://github.com/ali-vilab/FACM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ce919cf8-efe3-4d14-9d24-aec445595ca9Cited by top-tier papers8
- Improved Mean Flows: On the Challenges of Fastforward Generative ModelsZhengyang Geng, Yiyang Lu, Zongze Wu, Eli Shechtman et al.CVPR 2026 · 116 citations
- Transition Models: Rethinking the Generative Learning ObjectiveZidong Wang, Yiyuan Zhang, Xiaoyu Yue, Xiangyu Yue et al.CVPR 2026 · 32 citations
- TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial FlowsZhenglin Cheng, Peng Sun, Jianguo Li, Tao LinICLR 2026 · 17 citations
- Towards Sequence Modeling Alignment between Tokenizer and Autoregressive ModelPingyu Wu, Kai Zhu, Yu Liu, Longxiang Tang et al.ICLR 2026 · 16 citations
- Flow Map Distillation Without DataShangyuan Tong, Nanye Ma, Saining Xie, Tommi S. JaakkolaCVPR 2026 · 13 citations
Builds on15
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- FlashAttention-2: Faster Attention with Better Parallelism and Work PartitioningTri DaoICLR 2024 · 2,600 citations
- Mean Flows for One-step Generative ModelingZhengyang Geng, Mingyang Deng, Xingjian Bai, Zico Kolter et al.NeurIPS 2025 · 628 citations
Related papers
- CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow-Map ModelsZheyuan Hu, Chieh-Hsin Lai, Yuki Mitsufuji, Stefano ErmonICLR 2026 · 21 citations
- Simplifying, Stabilizing and Scaling Continuous-time Consistency ModelsCheng Lu, Yang SongICLR 2025
- Large Scale Diffusion Distillation via Score-Regularized Continuous-Time ConsistencyKaiwen Zheng, Yuji Wang, Qianli Ma, Huayu Chen et al.ICLR 2026 · 77 citations
- Align Your Flow: Scaling Continuous-Time Flow Map DistillationAmirmojtaba Sabour, Sanja Fidler, Karsten KreisNeurIPS 2025 · 91 citations
- AlphaFlow: Understanding and Improving MeanFlow ModelsHuijie Zhang, Aliaksandr Siarohin, Willi Menapace, Michael Vasilkovsky et al.ICLR 2026 · 44 citations
