PLay: Parametrically Conditioned Layout Generation using Latent Diffusion
Chin-Yi Cheng, Forrest Huang, Gang Li, Yang Li
Abstract
Layout design is an important task in various design fields, including user interface, document, and graphic design. As this task requires tedious manual effort by designers, prior works have attempted to automate this process using generative models, but commonly fell short of providing intuitive user controls and achieving design objectives. In this paper, we build a conditional latent diffusion model, PLay, that generates parametrically conditioned layouts in vector graphic space from user-specified guidelines, which are commonly used by designers for representing their design intents in current practices. Our method outperforms prior works across three datasets on metrics including FID and FD-VG, and in user study. Moreover, it brings a novel and interactive experience to professional layout design processes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers16
- Hierarchical Neural Coding for Controllable CAD Model GenerationXiang Xu, Pradeep Kumar Jayaraman, Joseph George Lambourne, Karl D. D. Willis et al.ICML 2023 · 88 citations
- Generating Automatic Feedback on UI Mockups with Large Language ModelsPeitong Duan, Jeremy Warner, Yang Li, Bjoern HartmannCHI 2024 · 81 citations
- Misty: UI Prototyping Through Interactive Conceptual BlendingYuwen Lu, Alan Leung, Amanda Swearngin, Jeffrey Nichols et al.CHI 2025 · 41 citations
- Towards Aligned Layout Generation via Diffusion Model with Aesthetic ConstraintsJian Chen, Ruiyi Zhang, Yufan Zhou, Changyou ChenICLR 2024 · 32 citations
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language ModelsZecheng Tang, Chenfei Wu, Juntao Li, Nan DuanICLR 2024 · 25 citations
Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
- Palette: Image-to-Image Diffusion ModelsChitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee et al.SIGGRAPH 2022 · 1,638 citations
Related papers
- Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout GenerationMohammad Amin Shabani, Zhaowen Wang, Difan Liu, Nanxuan Zhao et al.CVPR 2024 · 7 citations
- Constrained Graphic Layout Generation via Latent OptimizationKotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota YamaguchiACM MM 2021 · 80 citations
- LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic ModelsJunyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou et al.ICCV 2023 · 58 citations
- LayoutDM: Discrete Diffusion Model for Controllable Layout GenerationNaoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani et al.CVPR 2023
- DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout TransformerElad Levi, Eli Brosh, Mykola Mykhailych, Meir PerezICCV 2023 · 28 citations
