Sketch Generation with Drawing Process Guided by Vector Flow and Grayscale
Zhengyan Tong, Xuanhong Chen, Bingbing Ni, Xiaohang Wang
Abstract
We propose a novel image-to-pencil translation method that could not only generate high-quality pencil sketches but also offer the drawing process. Existing pencil sketch algorithms are based on texture rendering rather than the direct imitation of strokes, making them unable to show the drawing process but only a final result. To address this challenge, we first establish a pencil stroke imitation mechanism. Next, we develop a framework with three branches to guide stroke drawing: the first branch guides the direction of the strokes, the second branch determines the shade of the strokes, and the third branch enhances the details further. Under this framework's guidance, we can produce a pencil sketch by drawing one stroke every time. Our method is fully interpretable. Comparison with existing pencil drawing algorithms shows that our method is superior to others in terms of texture quality, style, and user evaluation. Our code and supplementary material are now available at: https://github.com/TZYSJTU/Sketch-Generation-withDrawing-Process-Guided-by-Vector-Flow-and-Grayscale
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55b79455-625a-485e-a3ad-0ae9a3aedce0Cited by top-tier papers5
- DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion ModelsXiming Xing, Chuang Wang, Haitao Zhou, Jing Zhang et al.NeurIPS 2023 · 101 citations
- CLIPascene: Scene Sketching with Different Types and Levels of AbstractionYael Vinker, Yuval Alaluf, Daniel Cohen-Or, Ariel ShamirICCV 2023 · 93 citations
- Im2Oil: Stroke-Based Oil Painting Rendering with Linearly Controllable Fineness Via Adaptive SamplingZhengyan Tong, Xiaohang Wang, Shengchao Yuan, Xuanhong Chen et al.ACM MM 2022 · 15 citations
- Freehand Sketch Generation from Mechanical ComponentsZhichao Liao, Fengyuan Piao, Di Huang, Xinghui Li et al.ACM MM 2024 · 12 citations
- Semantic Scale Space: A Framework for Controllable Image AbstractionKazu MishibaCVPR 2026
Builds on1
Related papers
- DeepFacePencil: Creating Face Images from Freehand SketchesYuhang Li, Xuejin Chen, Binxin Yang, Zihan Chen et al.ACM MM 2020 · 56 citations
- Stylized Neural PaintingZhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan et al.CVPR 2021
- Semi-supervised reference-based sketch extraction using a contrastive learning frameworkChang Wook Seo, Amirsaman Ashtari, Junyong NohSIGGRAPH 2023 · 14 citations
- Sketch2Mesh: Reconstructing and Editing 3D Shapes from SketchesBenoît Guillard, Edoardo Remelli, Pierre Yvernay, Pascal FuaICCV 2021 · 102 citations
- Rethinking Style Transfer: From Pixels to Parameterized BrushstrokesDmytro Kotovenko, Matthias Wright, Arthur Heimbrecht, Björn OmmerCVPR 2021
