Diffusion Model is Effectively Its Own Teacher
Xinyin Ma, Runpeng Yu, Songhua Liu, Gongfan Fang, Xinchao Wang
2025Year
4Top-tier citations
Abstract
DiT-XL/2 For ImageNet 512×512 (b) Stable Diffusion v1.5 Figure 1. Generated Images before (left) and after (right) our proposed self-distillation framework on DiT-XL/2 for ImageNet 512⇥512 and Stable Diffusion v1.5 with 10 DDIM sampling steps.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9b776a33-4935-4626-869d-3b10d25bba8eCited by top-tier papers4
- SRA 2: Variational Autoencoder Self-Representation Alignment for Efficient Diffusion TrainingMengmeng Wang, Dengyang Jiang, Liuzhuozheng Li, Yucheng Lin et al.CVPR 2026 · 9 citations
- Fast3Dcache: Training-free 3D Geometry Synthesis AccelerationMengyu Yang, Yanming Yang, Chenyi Xu, Chenxi Song et al.CVPR 2026 · 4 citations
- FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-ResolutionSeungho Choi, Jeahun Sung, Jihyong OhCVPR 2026 · 3 citations
- 2ndMatch: Finetuning Pruned Diffusion Models via Second-Order Jacobian MatchingCaleb Zheng, Eli ShlizermanCVPR 2026
Builds on41
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- On Distillation of Guided Diffusion ModelsChenlin Meng, Robin Rombach, Ruiqi Gao, Diederik P. Kingma et al.CVPR 2023
- Diffusion Self-Distillation for Zero-Shot Customized Image GenerationShengqu Cai, Eric Ryan Chan, Yunzhi Zhang, Leonidas J. Guibas et al.CVPR 2025
- One-Step Diffusion with Distribution Matching DistillationTianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman et al.CVPR 2024 · 75 citations
- Progressive Distillation for Fast Sampling of Diffusion ModelsTim Salimans, Jonathan HoICLR 2022 · 9 citations
- Multistep Distillation of Diffusion Models via Moment MatchingTim Salimans, Thomas Mensink, Jonathan Heek, Emiel HoogeboomNeurIPS 2024 · 93 citations
