Generalizing Dataset Distillation via Deep Generative Prior

ImageNet-Fruits Pineapple Banana Strawberry Orange Lemon Bell Pepper Pomegranate Fig Cucumber Granny Smith ImageNet-Cats Egyptian Siamese Tabby Bengal Persian Tiger Jaguar Lion Snow Leopard Lynx Figure 1. Visualizations of distilled images from three ImageNet subsets. Rather than distilling into pixel space, our Deep Generative Prior constrains the images to be more coherent, leading to better cross-architectural generalization.