SONA: Learning Conditional, Unconditional, and Matching-Aware Discriminator
Yuhta Takida, Satoshi Hayakawa, Takashi Shibuya, Masaaki Imaizumi, Naoki Murata, Bac Nguyen, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuki Mitsufuji
Abstract
Deep generative models have made significant advances in generating complex content, yet conditional generation remains a fundamental challenge. Existing conditional generative adversarial networks often struggle to balance the dual objectives of assessing authenticity and conditional alignment of input samples within their conditional discriminators. To address this, we propose a novel discriminator design that integrates three key capabilities: unconditional discrimination, matching-aware supervision to enhance alignment sensitivity, and adaptive weighting to dynamically balance all objectives. Specifically, we introduce Sum of Naturalness and Alignment (SONA), which employs separate projections for naturalness (authenticity) and alignment in the final layer with an inductive bias, supported by dedicated objective functions and an adaptive weighting mechanism. Extensive experiments on class-conditional generation tasks show that SONA achieves superior sample quality and conditional alignment compared to state-of-the-art methods. Furthermore, we demonstrate its effectiveness in text-to-image generation, confirming the versatility and robustness of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on30
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
Related papers
- Dual Projection Generative Adversarial Networks for Conditional Image GenerationLigong Han, Martin Renqiang Min, Anastasis Stathopoulos, Yu Tian et al.ICCV 2021 · 22 citations
- Conditional GANs with Auxiliary Discriminative ClassifierLiang Hou, Qi Cao, Huawei Shen, Siyuan Pan et al.ICML 2022 · 49 citations
- Adaptive Weighted Discriminator for Training Generative Adversarial NetworksVasily Zadorozhnyy, Qiang Cheng, Qiang YeCVPR 2021
- Discriminative Probing and Tuning for Text-to-Image GenerationLeigang Qu, Wenjie Wang, Yongqi Li, Hanwang Zhang et al.CVPR 2024 · 7 citations
- Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model AdaptationGuy Yariv, Itai Gat, Sagie Benaim, Lior Wolf et al.AAAI 2024 · 79 citations
