UniSketch: A Unified Framework for Parametric Sketch Generation and Constraint Prediction
Jing Lin, Fazhi He, Rubin Fan
Abstract
In modern Computer-Aided Design (CAD), parametric sketches play a crucial role by capturing both the geometric structure and design intent through constraints. However, existing deep learning–based sketch methods remain restricted to simple geometric primitives and limited constraint types, hindering their application to complex real-world engineering tasks. To address this gap, we introduce the UniSketch dataset, comprising 3,836,290 sketches. It offers a comprehensive and diverse collection of 7 types of geometric primitives and 23 types of 2D constraints, all represented as unified vector sequences suitable for deep learning applications. Leveraging the UniSketch dataset, we propose a unified multi-task Transformer framework as a true foundation model for parametric sketch modeling, supporting diverse core tasks like image-to-sketch generation, constraint prediction, and unconditional sketch synthesis. Furthermore, the generated sketches can be efficiently converted to CAD-compatible formats, enabling seamless integration with industrial CAD system for re-editing and reusing. The experimental results show that UniSketch outperforms existing methods in multiple tasks, demonstrating its versatility and practical value in industrial CAD applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1e685723-806e-489e-a4fe-38f29e1293d5Builds on8
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- DeepCAD: A Deep Generative Network for Computer-Aided Design ModelsRundi Wu, Chang Xiao, Changxi ZhengICCV 2021 · 290 citations
- DeepSVG: A Hierarchical Generative Network for Vector Graphics AnimationAlexandre Carlier, Martin Danelljan, Alexandre Alahi, Radu TimofteNeurIPS 2020 · 247 citations
- Fusion 360 gallery: a dataset and environment for programmatic CAD construction from human design sequencesKarl D. D. Willis, Yewen Pu, Jieliang Luo, Hang Chu et al.SIGGRAPH 2021 · 197 citations
- Computer-Aided Design as LanguageYaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller et al.NeurIPS 2021 · 129 citations
Related papers
- SketchGen: Generating Constrained CAD SketchesWamiq Reyaz Para, Shariq Farooq Bhat, Paul Guerrero, Tom Kelly et al.NeurIPS 2021 · 114 citations
- Vitruvion: A Generative Model of Parametric CAD SketchesAri Seff, Wenda Zhou, Nick Richardson, Ryan P. AdamsICLR 2022 · 86 citations
- Drawing2CAD: Sequence-to-Sequence Learning for CAD Generation from Vector DrawingsFeiwei Qin, Shichao Lu, Junhao Hou, Changmiao Wang et al.ACM MM 2025 · 4 citations
- Free2CAD: parsing freehand drawings into CAD commandsChangjian Li, Hao Pan, Adrien Bousseau, Niloy J. MitraSIGGRAPH 2022 · 100 citations
- Constraint-Aware Feature Learning for Parametric Point CloudXi Cheng, Ruiqi Lei, Di Huang, Zhichao Liao et al.ICCV 2025 · 1 citation
