When StyleGAN Meets Stable Diffusion: a \mathcal{W}_{+} Adapter for Personalized Image Generation

Xiaoming Li; Xinyu Hou; Chen Change Loy

doi:10.1109/cvpr52733.2024.00213

CVPR2024Top-tier venue

When StyleGAN Meets Stable Diffusion: a $\mathcal{W}_{+}$ Adapter for Personalized Image Generation

Xiaoming Li, Xinyu Hou, Chen Change Loy

DOI Publisher

2024Year

Abstract

Ours with Fine-grained Attributes Editing Age Eye Close Smile Figure 1 . Given a single reference image (thumbnail in the top left), our W+ adapter not only integrates the identity into the text-to-image generation accurately but also enables modifications of facial attributes along the ∆w trajectory derived from StyleGAN. The text prompt is "a woman wearing a spacesuit in a forest".

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

What it claims
How it compares
Where it falls short

You ask

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

Builds on20

Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations

Abstract

Ask about this paper

Your agent reads all of it.

Builds on20

Related papers