VCT: Training Consistency Models with Variational Noise Coupling
Gianluigi Silvestri, Luca Ambrogioni, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji
摘要
Consistency Training (CT) has recently emerged as a strong alternative to diffusion models for image generation. However, non-distillation CT often suffers from high variance and instability, motivating ongoing research into its training dynamics. We propose Variational Consistency Training (VCT), a flexible and effective framework compatible with various forward kernels, including those in flow matching. Its key innovation is a learned noise-data coupling scheme inspired by Variational Autoencoders, where a data-dependent encoder models noise emission. This enables VCT to adaptively learn noise-todata pairings, reducing training variance relative to the fixed, unsorted pairings in classical CT. Experiments on multiple image datasets demonstrate significant improvements: our method surpasses baselines, achieves state-of-the-art FID among non-distillation CT approaches on CIFAR-10, and matches SoTA performance on ImageNet 64 × 64 with only two sampling steps. Code is available at https://github.com/sony/vct .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow-Map ModelsZheyuan Hu, Chieh-Hsin Lai, Yuki Mitsufuji, Stefano ErmonICLR 2026 · 被引用 21 次
- Learning Straight Flows: Variational Flow Matching for Efficient GenerationChenrui Ma, Xi Xiao, Tianyang Wang, Xiao Wang 等CVPR 2026 · 被引用 9 次
它引用的顶会 Paper39
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
相关 Paper
- Improved Techniques for Training Consistency ModelsYang Song, Prafulla DhariwalICLR 2024 · 被引用 383 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- Improving Consistency Models with Generator-Augmented FlowsThibaut Issenhuth, Sangchul Lee, Ludovic Dos Santos, Jean-Yves Franceschi 等ICML 2025
- ACT-Diffusion: Efficient Adversarial Consistency Training for One-Step Diffusion ModelsFei Kong, Jinhao Duan, Lichao Sun, Hao Cheng 等CVPR 2024
- See Further When Clear: Curriculum Consistency ModelYunpeng Liu, Boxiao Liu, Yi Zhang, Xingzhong Hou 等CVPR 2025
