Random Conditioning for Diffusion Model Compression with Distillation

Diffusion models generate high-quality images through progressive denoising but are computationally intensive due to large model sizes and repeated sampling. Knowledge distillation-transferring knowledge from a complex teacher to a simpler student model-has been widely studied in recognition tasks, particularly for transferring concepts unseen during student training. However, its application to diffusion models remains underexplored, especially in enabling student models to generate concepts not covered by the training images. In this work, we propose Random Conditioning, a novel approach that pairs noised images with randomly selected text conditions to enable efficient, imagefree knowledge distillation. By leveraging this technique, we show that the student can generate concepts unseen in the training images. When applied to conditional diffusion model distillation, our method allows the student to explore the condition space without generating conditionspecific images, resulting in notable improvements in both generation quality and efficiency. This promotes resourceefficient deployment of generative diffusion models, broadening their accessibility for both research and real-world applications. Code, models, and datasets are available at: https://dohyun-as.github.io/Random- Conditioning * Equal contribution Teacher Student w/o Rand Cond Student w/ Rand Cond (a) Non-Animal Condition (b) Animal Condition