Diverse Multimedia Layout Generation with Multi Choice Learning
David D. Nguyen, Surya Nepal, Salil S. Kanhere
Abstract
Designing visually appealing layouts for multimedia documents containing text, graphs and images requires a form of creative intelligence. Modelling the generation of layouts has recently gained attention due to its importance in aesthetics and communication style. In contrast to standard prediction tasks, there are a range of acceptable layouts which depend on user preferences. For example, a poster designer may prefer logos on the top-left while another prefers logos on the bottom-right. Both are correct choices yet existing machine learning models treat layouts as a single choice prediction problem. In such situations, these models would simply average over all possible choices given the same input forming a degenerate sample. In the above example, this would form an unacceptable layout with a logo in the centre.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic ModelsJunyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou et al.ICCV 2023 · 58 citations
- PLay: Parametrically Conditioned Layout Generation using Latent DiffusionChin-Yi Cheng, Forrest Huang, Gang Li, Yang LiICML 2023 · 45 citations
- Multiple Hypothesis Dropout: Estimating the Parameters of Multi-Modal Output DistributionsDavid D. Nguyen, David Liebowitz, Salil S. Kanhere, Surya NepalAAAI 2024 · 1 citation
- Multimodal Markup Document Models for Graphic Design CompletionKotaro Kikuchi, Ukyo Honda, Naoto Inoue, Mayu Otani et al.ACM MM 2025 · 1 citation
- LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space RestrictionZhaoyun Jiang, Jiaqi Guo, Shizhao Sun, Huayu Deng et al.CVPR 2023
Builds on1
Related papers
- GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph LayoutsJunwen He, Yifan Wang, Lijun Wang, Huchuan Lu et al.ACM MM 2025 · 1 citation
- Geometry Aligned Variational Transformer for Image-conditioned Layout GenerationYunning Cao, Ye Ma, Min Zhou, Chuanbin Liu et al.ACM MM 2022 · 37 citations
- Constrained Graphic Layout Generation via Latent OptimizationKotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota YamaguchiACM MM 2021 · 80 citations
- AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language ModelsSohan Patnaik, Rishabh Jain, Balaji Krishnamurthy, Mausoom SarkarCVPR 2025
- PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout GenerationHsiaoYuan Hsu, Yuxin PengCVPR 2025
