SONA: Learning Conditional, Unconditional, and Matching-Aware Discriminator
Yuhta Takida, Satoshi Hayakawa, Takashi Shibuya, Masaaki Imaizumi, Naoki Murata, Bac Nguyen, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuki Mitsufuji
摘要
Deep generative models have made significant advances in generating complex content, yet conditional generation remains a fundamental challenge. Existing conditional generative adversarial networks often struggle to balance the dual objectives of assessing authenticity and conditional alignment of input samples within their conditional discriminators. To address this, we propose a novel discriminator design that integrates three key capabilities: unconditional discrimination, matching-aware supervision to enhance alignment sensitivity, and adaptive weighting to dynamically balance all objectives. Specifically, we introduce Sum of Naturalness and Alignment (SONA), which employs separate projections for naturalness (authenticity) and alignment in the final layer with an inductive bias, supported by dedicated objective functions and an adaptive weighting mechanism. Extensive experiments on class-conditional generation tasks show that SONA achieves superior sample quality and conditional alignment compared to state-of-the-art methods. Furthermore, we demonstrate its effectiveness in text-to-image generation, confirming the versatility and robustness of our approach.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper30
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann 等ICLR 2024 · 被引用 4,569 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine 等NeurIPS 2020 · 被引用 2,345 次
相关 Paper
- Dual Projection Generative Adversarial Networks for Conditional Image GenerationLigong Han, Martin Renqiang Min, Anastasis Stathopoulos, Yu Tian 等ICCV 2021 · 被引用 22 次
- Conditional GANs with Auxiliary Discriminative ClassifierLiang Hou, Qi Cao, Huawei Shen, Siyuan Pan 等ICML 2022 · 被引用 49 次
- Adaptive Weighted Discriminator for Training Generative Adversarial NetworksVasily Zadorozhnyy, Qiang Cheng, Qiang YeCVPR 2021
- Discriminative Probing and Tuning for Text-to-Image GenerationLeigang Qu, Wenjie Wang, Yongqi Li, Hanwang Zhang 等CVPR 2024 · 被引用 7 次
- Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model AdaptationGuy Yariv, Itai Gat, Sagie Benaim, Lior Wolf 等AAAI 2024 · 被引用 79 次
