Co-Evolutionary Compression for Unpaired Image Translation
Han Shu, Yunhe Wang, Xu Jia, Kai Han, Hanting Chen, Chunjing Xu, Qi Tian, Chang Xu
Abstract
Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation. However, generators in these networks are of complicated architectures with large number of parameters and huge computational complexities. Existing methods are mainly designed for compressing and speeding-up deep neural networks in the classification task, and cannot be directly applied on GANs for image translation, due to their different objectives and training procedures. To this end, we develop a novel co-evolutionary approach for reducing their memory usage and FLOPs simultaneously. In practice, generators for two image domains are encoded as two populations and synergistically optimized for investigating the most important convolution filters iteratively. Fitness of each individual is calculated using the number of parameters, a discriminator-aware regularization, and the cycle consistency. Extensive experiments conducted on benchmark datasets demonstrate the effectiveness of the proposed method for obtaining compact and effective generators.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65df56d4-755f-46d1-8c96-ed27a09d515bCited by top-tier papers22
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu et al.NeurIPS 2020 · 707 citations
- Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNetsKai Han, Yunhe Wang, Qiulin Zhang, Wei Zhang et al.NeurIPS 2020 · 115 citations
- AutoGAN-Distiller: Searching to Compress Generative Adversarial NetworksYonggan Fu, Wuyang Chen, Haotao Wang, Haoran Li et al.ICML 2020 · 91 citations
- Efficient Spatially Sparse Inference for Conditional GANs and Diffusion ModelsMuyang Li, Ji Lin, Chenlin Meng, Stefano Ermon et al.NeurIPS 2022 · 66 citations
- Training Binary Neural Networks through Learning with Noisy SupervisionKai Han, Yunhe Wang, Yixing Xu, Chunjing Xu et al.ICML 2020 · 63 citations
Related papers
- Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned ManifoldAlireza Ganjdanesh, Shangqian Gao, Hirad Alipanah, Heng HuangAAAI 2024 · 11 citations
- Distilling Portable Generative Adversarial Networks for Image TranslationHanting Chen, Yunhe Wang, Han Shu, Changyuan Wen et al.AAAI 2020 · 89 citations
- Wavelet Knowledge Distillation: Towards Efficient Image-to-Image TranslationLinfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan et al.CVPR 2022 · 105 citations
- Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression SchemeShaojie Li, Jie Wu, Xuefeng Xiao, Fei Chao et al.NeurIPS 2021 · 42 citations
- Sparsity Aware Normalization for GANsIdan Kligvasser, Tomer MichaeliAAAI 2021 · 6 citations
