Multimodal Latent Diffusion Model for Complex Sewing Pattern Generation
Shengqi Liu, Yuhao Cheng, Zhuo Chen, Xingyu Ren, Wenhan Zhu, Lincheng Li, Mengxiao Bi, Xiaokang Yang, Yichao Yan
Abstract
Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to design complex garments with detailed control. To address these issues, we propose SewingLDM, a multi-modal generative model that generates sewing patterns controlled by text prompts, body shapes, and garment sketches. Initially, we extend the original vector of sewing patterns into a more comprehensive representation to cover more intricate details and then compress them into a compact latent space. To learn the sewing pattern distribution in the latent space, we design a two-step training strategy to inject the multi-modal conditions, , body shapes, text prompts, and garment sketches, into a diffusion model, ensuring the generated garments are body-suited and detail-controlled. Comprehensive qualitative and quantitative experiments show the effectiveness of our proposed method, significantly surpassing previous approaches in terms of complex garment design and various body adaptability. Our project page: https://shengqiliu1.github.io/SewingLDM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 289348fb-48aa-48fa-b696-0c7ffdba3805Cited by top-tier papers5
- Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable PhysicsXuan Li, Chang Yu, Wenxin Du, Ying Jiang et al.SIGGRAPH 2025 · 12 citations
- Rags2Riches: Computational Garment ReuseAnran Qi, Nico Pietroni, Maria Korosteleva, Olga Sorkine-Hornung et al.SIGGRAPH 2025 · 6 citations
- ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment ReconstructionMing Li, Hui Shan, Kai Zheng, Chentao Shen et al.CVPR 2026 · 2 citations
- SwiftTailor: Efficient 3D Garment Generation with Geometry Image RepresentationPhuc Pham, Uy Dieu Tran, Binh-Son Hua, Phong NguyenCVPR 2026
- GarmentGPT: Compositional Garment Pattern Generation via Discrete Latent TokenizationFangsheng Weng, Junhao Chen, Xiang Li, Jie Qin et al.ICLR 2026
Builds on32
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program SynthesisFeng Zhou, Ruiyang Liu, Chen Liu, Gaofeng He et al.CVPR 2025
- Learning Sewing Patterns via Latent Flow Matching of Implicit FieldsCong Cao, Ren Li, Corentin Dumery, Hao LiSIGGRAPH 2026
- Garment Particles: A 2D-3D Symmetric Garment Representation for Generation and EditingKiyohiro Nakayama, I-Chao Shen, Ruofan Liu, Yiming Wang et al.SIGGRAPH 2026 · 1 citation
- DressCode: Autoregressively Sewing and Generating Garments from Text GuidanceKai He, Kaixin Yao, Qixuan Zhang, Jingyi Yu et al.SIGGRAPH 2024 · 43 citations
- AIpparel: A Multimodal Foundation Model for Digital GarmentsKiyohiro Nakayama, Jan Ackermann, Timur Levent Kesdogan, Yang Zheng et al.CVPR 2025
