Co-Evolutionary Compression for Unpaired Image Translation
Han Shu, Yunhe Wang, Xu Jia, Kai Han, Hanting Chen, Chunjing Xu, Qi Tian, Chang Xu
摘要
Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation. However, generators in these networks are of complicated architectures with large number of parameters and huge computational complexities. Existing methods are mainly designed for compressing and speeding-up deep neural networks in the classification task, and cannot be directly applied on GANs for image translation, due to their different objectives and training procedures. To this end, we develop a novel co-evolutionary approach for reducing their memory usage and FLOPs simultaneously. In practice, generators for two image domains are encoded as two populations and synergistically optimized for investigating the most important convolution filters iteratively. Fitness of each individual is calculated using the number of parameters, a discriminator-aware regularization, and the cycle consistency. Extensive experiments conducted on benchmark datasets demonstrate the effectiveness of the proposed method for obtaining compact and effective generators.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper22
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu 等NeurIPS 2020 · 被引用 707 次
- Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNetsKai Han, Yunhe Wang, Qiulin Zhang, Wei Zhang 等NeurIPS 2020 · 被引用 115 次
- AutoGAN-Distiller: Searching to Compress Generative Adversarial NetworksYonggan Fu, Wuyang Chen, Haotao Wang, Haoran Li 等ICML 2020 · 被引用 91 次
- Efficient Spatially Sparse Inference for Conditional GANs and Diffusion ModelsMuyang Li, Ji Lin, Chenlin Meng, Stefano Ermon 等NeurIPS 2022 · 被引用 66 次
- Training Binary Neural Networks through Learning with Noisy SupervisionKai Han, Yunhe Wang, Yixing Xu, Chunjing Xu 等ICML 2020 · 被引用 63 次
相关 Paper
- Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned ManifoldAlireza Ganjdanesh, Shangqian Gao, Hirad Alipanah, Heng HuangAAAI 2024 · 被引用 11 次
- Distilling Portable Generative Adversarial Networks for Image TranslationHanting Chen, Yunhe Wang, Han Shu, Changyuan Wen 等AAAI 2020 · 被引用 89 次
- Wavelet Knowledge Distillation: Towards Efficient Image-to-Image TranslationLinfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan 等CVPR 2022 · 被引用 105 次
- Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression SchemeShaojie Li, Jie Wu, Xuefeng Xiao, Fei Chao 等NeurIPS 2021 · 被引用 42 次
- Sparsity Aware Normalization for GANsIdan Kligvasser, Tomer MichaeliAAAI 2021 · 被引用 6 次
