Img2CADSeq: Image-to-CAD Generation via Sequence-Based Diffusion
Shiyu Tan, Zixuan Zhao, Hao Gao, Zhiheng Chen, Xiaolong Yin, Enya Shen
Abstract
Boundary Representation (BRep) is the standard format for Computer-Aided Design (CAD), yet reconstructing high-quality BReps from single-view images remains challenging due to the complexity of topological constraints and operation sequences. We present Img2CADSeq, a multi-stage pipeline that overcomes these limitations by encoding CAD sequences into a three-level hierarchical codebook. Guided by an importance prioritization, this strategy values profiles over details, compressing long sequences into a stable discrete latent space. To bridge the modality gap, we leverage a coarse-to-fine point cloud intermediate, aligning 2D visual features with 3D CAD sequences via contrastive learning to condition a VQ-Diffusion model. Supported by newly introduced CAD-220K and PrintCAD datasets, our approach ensures robust industrial domain adaptation. Extensive experiments demonstrate that Img2CADSeq significantly outperforms state-of-the-art methods, producing standard STEP files that can be directly used in commercial CAD software. Code and data for this paper are at https://github.com/Rilpraa0110/Img2CADSeq
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 213ca426-cf64-41a2-a160-24e09b7791e0Builds on15
- Vector Quantized Diffusion Model for Text-to-Image SynthesisShuyang Gu, Dong Chen, Jianmin Bao, Fang Wen et al.CVPR 2022 · 607 citations
- Wonder3D: Single Image to 3D Using Cross-Domain DiffusionXiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu et al.CVPR 2024 · 269 citations
- SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled CodebooksXiang Xu, Karl D. D. Willis, Joseph G. Lambourne, Chin-Yi Cheng et al.ICML 2022 · 126 citations
- Hierarchical Neural Coding for Controllable CAD Model GenerationXiang Xu, Pradeep Kumar Jayaraman, Joseph George Lambourne, Karl D. D. Willis et al.ICML 2023 · 88 citations
- HPNet: Deep Primitive Segmentation Using Hybrid RepresentationsSiming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang et al.ICCV 2021 · 67 citations
Related papers
- Draw Step by Step: Reconstructing CAD Construction Sequences from Point Clouds via Multimodal DiffusionWeijian Ma, Shuaiqi Chen, Yunzhong Lou, Xueyang Li et al.CVPR 2024 · 14 citations
- CAD Translator: An Effective Drive for Text to 3D Parametric Computer-Aided Design Generative ModelingXueyang Li, Yu Song, Yunzhong Lou, Xiangdong ZhouACM MM 2024 · 16 citations
- HoLa: B-Rep Generation using a Holistic Latent RepresentationYilin Liu, Duoteng Xu, Xingyao Yu, Xiang Xu et al.SIGGRAPH 2025 · 15 citations
- DeepCAD: A Deep Generative Network for Computer-Aided Design ModelsRundi Wu, Chang Xiao, Changxi ZhengICCV 2021 · 290 citations
- BrepGen: A B-rep Generative Diffusion Model with Structured Latent GeometryXiang Xu, Joseph G. Lambourne, Pradeep Kumar Jayaraman, Zhengqing Wang et al.SIGGRAPH 2024 · 62 citations
