CanvasVAE: Learning to Generate Vector Graphic Documents
Kota Yamaguchi
Abstract
Vector graphic documents present visual elements in a resolution free, compact format and are often seen in creative applications. In this work, we attempt to learn a generative model of vector graphic documents. We define vector graphic documents by a multi-modal set of attributes associated to a canvas and a sequence of visual elements such as shapes, images, or texts, and train variational autoencoders to learn the representation of the documents. We collect a new dataset of design templates from an online service that features complete document structure including occluded elements. In experiments, we show that our model, named CanvasVAE, constitutes a strong baseline for generative modeling of vector graphic documents.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f1b62010-d6f9-40f8-acc5-933a3293f3f4Cited by top-tier papers23
- LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic ModelsJunyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou et al.ICCV 2023 · 58 citations
- Qwen-Image-Layered: Towards Inherent Editability via Layer DecompositionShengming Yin, Zekai Zhang, Zecheng Tang, Kaiyuan Gao et al.CVPR 2026 · 30 citations
- A Parse-Then-Place Approach for Generating Graphic Layouts from Textual DescriptionsJiawei Lin, Jiaqi Guo, Shizhao Sun, Weijiang Xu et al.ICCV 2023 · 19 citations
- Desigen: A Pipeline for Controllable Design Template GenerationHaohan Weng, Danqing Huang, Yu Qiao, Zheng Hu et al.CVPR 2024 · 10 citations
- Multimodal Color Recommendation in Vector Graphic DocumentsQianru Qiu, Xueting Wang, Mayu OtaniACM MM 2023 · 7 citations
Builds on8
- DeepSVG: A Hierarchical Generative Network for Vector Graphics AnimationAlexandre Carlier, Martin Danelljan, Alexandre Alahi, Radu TimofteNeurIPS 2020 · 247 citations
- LayoutVAE: Stochastic Scene Layout Generation From a Label SetAkash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal et al.ICCV 2019 · 194 citations
- LayoutTransformer: Layout Generation and Completion with Self-attentionKamal Gupta, Justin Lazarow, Alessandro Achille, Larry Davis et al.ICCV 2021 · 184 citations
- A Learned Representation for Scalable Vector GraphicsRaphael Gontijo Lopes, David Ha, Douglas Eck, Jonathon ShlensICCV 2019 · 153 citations
- Screen2Vec: Semantic Embedding of GUI Screens and GUI ComponentsToby Jia-Jun Li, Lindsay Popowski, Tom M. Mitchell, Brad A. MyersCHI 2021 · 72 citations
Related papers
- Recognizing Vector Graphics without RasterizationXinyang Jiang, Lu Liu, Caihua Shan, Yifei Shen et al.NeurIPS 2021 · 28 citations
- Towards Flexible Multi-modal Document ModelsNaoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani et al.CVPR 2023
- CanvasEmb: Learning Layout Representation with Large-scale Pre-training for Graphic DesignYuxi Xie, Danqing Huang, Jinpeng Wang, Chin-Yew LinACM MM 2021 · 11 citations
- Im2Vec: Synthesizing Vector Graphics Without Vector SupervisionPradyumna Reddy, Michaël Gharbi, Michal Lukác, Niloy J. MitraCVPR 2021
- Modelling complex vector drawings with stroke-cloudsAlexander Ashcroft, Ayan Das, Yulia Gryaditskaya, Zhiyu Qu et al.ICLR 2024 · 5 citations
