Autoregressive Distillation of Diffusion Transformers

Yeongmin Kim, Sotiris Anagnostidis, Yuming Du, Edgar Schönfeld, Jonas Kohler, Markos Georgopoulos, Albert Pumarola, Ali K. Thabet, Artsiom Sanakoyeu

Abstract

Figure 1. Samples (1024 × 1024) generated by our 3-step ARD model, distilled from a 1.7B Emu.