UniSketch: A Unified Framework for Parametric Sketch Generation and Constraint Prediction
Jing Lin, Fazhi He, Rubin Fan
摘要
In modern Computer-Aided Design (CAD), parametric sketches play a crucial role by capturing both the geometric structure and design intent through constraints. However, existing deep learning–based sketch methods remain restricted to simple geometric primitives and limited constraint types, hindering their application to complex real-world engineering tasks. To address this gap, we introduce the UniSketch dataset, comprising 3,836,290 sketches. It offers a comprehensive and diverse collection of 7 types of geometric primitives and 23 types of 2D constraints, all represented as unified vector sequences suitable for deep learning applications. Leveraging the UniSketch dataset, we propose a unified multi-task Transformer framework as a true foundation model for parametric sketch modeling, supporting diverse core tasks like image-to-sketch generation, constraint prediction, and unconditional sketch synthesis. Furthermore, the generated sketches can be efficiently converted to CAD-compatible formats, enabling seamless integration with industrial CAD system for re-editing and reusing. The experimental results show that UniSketch outperforms existing methods in multiple tasks, demonstrating its versatility and practical value in industrial CAD applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- DeepCAD: A Deep Generative Network for Computer-Aided Design ModelsRundi Wu, Chang Xiao, Changxi ZhengICCV 2021 · 被引用 290 次
- DeepSVG: A Hierarchical Generative Network for Vector Graphics AnimationAlexandre Carlier, Martin Danelljan, Alexandre Alahi, Radu TimofteNeurIPS 2020 · 被引用 247 次
- Fusion 360 gallery: a dataset and environment for programmatic CAD construction from human design sequencesKarl D. D. Willis, Yewen Pu, Jieliang Luo, Hang Chu 等SIGGRAPH 2021 · 被引用 197 次
- Computer-Aided Design as LanguageYaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller 等NeurIPS 2021 · 被引用 129 次
相关 Paper
- SketchGen: Generating Constrained CAD SketchesWamiq Reyaz Para, Shariq Farooq Bhat, Paul Guerrero, Tom Kelly 等NeurIPS 2021 · 被引用 114 次
- Vitruvion: A Generative Model of Parametric CAD SketchesAri Seff, Wenda Zhou, Nick Richardson, Ryan P. AdamsICLR 2022 · 被引用 86 次
- Drawing2CAD: Sequence-to-Sequence Learning for CAD Generation from Vector DrawingsFeiwei Qin, Shichao Lu, Junhao Hou, Changmiao Wang 等ACM MM 2025 · 被引用 4 次
- Free2CAD: parsing freehand drawings into CAD commandsChangjian Li, Hao Pan, Adrien Bousseau, Niloy J. MitraSIGGRAPH 2022 · 被引用 100 次
- Constraint-Aware Feature Learning for Parametric Point CloudXi Cheng, Ruiqi Lei, Di Huang, Zhichao Liao 等ICCV 2025 · 被引用 1 次
