Lune

CVPR Findings2026

UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation

Zeyang Liu, Le Wang, Sanping Zhou, Yuxuan Wu, Xiaolong Sun, Gang Hua, Haoxiang Li

Abstract

Content-aware layout generation is a critical task in graphic design automation, focused on creating visually appealing arrangements of elements that seamlessly blend with a given background image. The variety of real-world applications makes it highly challenging to develop a single model capable of unifying the diverse range of inputconstrained generation sub-tasks, such as those conditioned by element types, sizes, or their relationships. Current methods either address only a subset of these tasks or necessitate separate model parameters for different conditions, failing to offer a truly unified solution. In this paper, we propose UniLayDiff: a Unified Diffusion Transformer, that for the first time, addresses various content-aware layout generation tasks with a single, end-to-end trainable model. Specifically, we treat layout constraints as a distinct modality and employ Multi-Modal Diffusion Transformer framework to capture the complex interplay between the background image, layout elements, and diverse constraints. Moreover, we integrate relation constraints through finetuning the model with LoRA after pretraining the model on other tasks. Such a schema not only achieves unified conditional generation but also enhances overall layout quality. Extensive experiments demonstrate that UniLayDiff achieves state-of-the-art performance across from unconditional to various conditional generation tasks and, to the best of our knowledge, is the first model to unify the full range of content-aware layout generation tasks.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Scalable Diffusion Models with Transformers cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  • Scalable Diffusion Models with Transformers cites Denoising Diffusion Probabilistic Models
  • Scaling Rectified Flow Transformers for High-Resolution Image Synthesis cites Scalable Diffusion Models with Transformers
  • Scaling Rectified Flow Transformers for High-Resolution Image Synthesis cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  • Scaling Rectified Flow Transformers for High-Resolution Image Synthesis cites Denoising Diffusion Probabilistic Models
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on23

  1. Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
  2. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
  3. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
  4. Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
  5. Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations

Related papers

  1. Towards Aligned Layout Generation via Diffusion Model with Aesthetic ConstraintsJian Chen, Ruiyi Zhang, Yufan Zhou, Changyou ChenICLR 2024 · 32 citations
  2. Unifying Layout Generation with a Decoupled Diffusion ModelMude Hui, Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie et al.CVPR 2023
  3. PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language ModelsRunze He, Bo Cheng, Yuhang Ma, Qingxiang Jia et al.ICCV 2025 · 1 citation
  4. DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout TransformerElad Levi, Eli Brosh, Mykola Mykhailych, Meir PerezICCV 2023 · 28 citations
  5. LayoutDM: Transformer-based Diffusion Model for Layout GenerationShang Chai, Liansheng Zhuang, Fengying YanCVPR 2023
Dusk over the sea between two cliffs drawn in fine vertical lines