Diverse Image Generation via Self-Conditioned GANs
Steven Liu, Tongzhou Wang, David Bau, Jun-Yan Zhu, Antonio Torralba
Abstract
We introduce a simple but effective unsupervised method for generating diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels automatically derived from clustering in the discriminator’s feature space. Our clustering step automatically discovers diverse modes, and explicitly requires the generator to cover them. Experiments on standard mode collapse benchmarks show that our method outperforms several competing methods when addressing mode collapse. Our method also performs well on large-scale datasets such as ImageNet and Places365, improving both diversity and standard metrics (e.g., Fréchet Inception Distance), compared to previous methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e6e45238-de39-4f3b-823f-a79b3a623fdfCited by top-tier papers36
- TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series DataShreshth Tuli, Giuliano Casale, Nicholas R. JenningsVLDB 2022 · 930 citations
- NExT-GPT: Any-to-Any Multimodal LLMShengqiong Wu, Hao Fei, Leigang Qu, Wei Ji et al.ICML 2024 · 786 citations
- Differentiable Augmentation for Data-Efficient GAN TrainingShengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu et al.NeurIPS 2020 · 707 citations
- On Aliased Resizing and Surprising Subtleties in GAN EvaluationGaurav Parmar, Richard Zhang, Jun-Yan ZhuCVPR 2022 · 250 citations
- Instance-Conditioned GANArantxa Casanova, Marlène Careil, Jakob Verbeek, Michal Drozdzal et al.NeurIPS 2021 · 167 citations
Builds on2
- Seeing What a GAN Cannot GenerateDavid Bau, Jun-Yan Zhu, Jonas Wulff, William S. Peebles et al.ICCV 2019 · 342 citations
- GAN-Tree: An Incrementally Learned Hierarchical Generative Framework for Multi-Modal Data DistributionsJogendra Nath Kundu, Maharshi Gor, Dakshit Agrawal, Venkatesh Babu RadhakrishnanICCV 2019 · 12 citations
Related papers
- Collapse by Conditioning: Training Class-conditional GANs with Limited DataMohamad Shahbazi, Martin Danelljan, Danda Pani Paudel, Luc Van GoolICLR 2022 · 39 citations
- A Novel Confidence Guided Training Method for Conditional GANs with Auxiliary ClassifierQi Chen, Wenjie Liu, Hu DingACM MM 2024
- UniGAN: Reducing Mode Collapse in GANs using a Uniform GeneratorZiqi Pan, Li Niu, Liqing ZhangNeurIPS 2022 · 17 citations
- Partition-Guided GANsMohammadreza Armandpour, Ali Sadeghian, Chunyuan Li, Mingyuan ZhouCVPR 2021
- Exploring Intra-class Variation Factors with Learnable Cluster Prompts for Semi-supervised Image SynthesisYunfei Zhang, Xiaoyang Huo, Tianyi Chen, Si Wu et al.CVPR 2023
