LayoutPrompter: Awaken the Design Ability of Large Language Models
Jiawei Lin, Jiaqi Guo, Shizhao Sun, Zijiang Yang, Jian-Guang Lou, Dongmei Zhang
Abstract
Conditional graphic layout generation, which automatically maps user constraints to high-quality layouts, has attracted widespread attention today. Although recent works have achieved promising performance, the lack of versatility and data efficiency hinders their practical applications. In this work, we propose LayoutPrompter, which leverages large language models (LLMs) to address the above problems through in-context learning. LayoutPrompter is made up of three key components, namely input-output serialization, dynamic exemplar selection and layout ranking. Specifically, the input-output serialization component meticulously designs the input and output formats for each layout generation task. Dynamic exemplar selection is responsible for selecting the most helpful prompting exemplars for a given input. And a layout ranker is used to pick the highest quality layout from multiple outputs of LLMs. We conduct experiments on all existing layout generation tasks using four public datasets. Despite the simplicity of our approach, experimental results show that LayoutPrompter can compete with or even outperform state-of-the-art approaches on these tasks without any model training or fine-tuning. This demonstrates the effectiveness of this versatile and training-free approach. In addition, the ablation studies show that LayoutPrompter is significantly superior to the training-based baseline in a low-data regime, further indicating the data efficiency of LayoutPrompter. Our project is available at https://github.com/microsoft/LayoutGeneration/tree/main/LayoutPrompter.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b2ffd66a-bf98-4101-85c9-4754a770883cCited by top-tier papers27
- PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified FrameworkSixiang Chen, Jianyu Lai, Jialin Gao, Tian Ye et al.ICLR 2026 · 43 citations
- GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language ModelsJian Ma, Yonglin Deng, Chen Chen, Nanyang Du et al.AAAI 2025 · 28 citations
- UICrit: Enhancing Automated Design Evaluation with a UI Critique DatasetPeitong Duan, Chin-Yi Cheng, Gang Li, Bjoern Hartmann et al.UIST 2024 · 22 citations
- P2P: Automated Paper-to-Poster Generation and Fine-Grained BenchmarkTao Sun, Enhao Pan, Zhengkai Yang, Kaixin Sui et al.ICLR 2026 · 19 citations
- PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward FeedbackSixiang Chen, Jianyu LAI, Jialin Gao, Hengyu Shi et al.CVPR 2026 · 9 citations
Builds on18
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech et al.NeurIPS 2022 · 6,707 citations
Related papers
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language ModelsZecheng Tang, Chenfei Wu, Juntao Li, Nan DuanICLR 2024 · 25 citations
- LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space RestrictionZhaoyun Jiang, Jiaqi Guo, Shizhao Sun, Huayu Deng et al.CVPR 2023
- Generative Layout Modeling using Constraint GraphsWamiq Para, Paul Guerrero, Tom Kelly, Leonidas J. Guibas et al.ICCV 2021 · 93 citations
- PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout GenerationHsiaoYuan Hsu, Yuxin PengCVPR 2025
- LayoutGPT: Compositional Visual Planning and Generation with Large Language ModelsWeixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani et al.NeurIPS 2023 · 462 citations
