Creative Sketch Generation
Songwei Ge, Vedanuj Goswami, Larry Zitnick, Devi Parikh
Abstract
Sketching or doodling is a popular creative activity that people engage in. However, most existing work in automatic sketch understanding or generation has focused on sketches that are quite mundane. In this work, we introduce two datasets of creative sketches -Creative Birds and Creative Creatures -containing 10k sketches each along with part annotations. We propose DoodlerGANa part-based Generative Adversarial Network (GAN) -to generate unseen compositions of novel part appearances. Quantitative evaluations as well as human studies demonstrate that sketches generated by our approach are more creative and of higher quality than existing approaches. In fact, in Creative Birds, subjects prefer sketches generated by DoodlerGAN over those drawn by humans! Our code, datasets and demo can be found at songweige.github.io/ projects/creative_sketech_generation/home.html.
The work was done when the first author interned at Facebook AI Research.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3e38302d-cd70-4ac2-a367-3f86fc2fd98dCited by top-tier papers24
- DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion ModelsXiming Xing, Chuang Wang, Haitao Zhou, Jing Zhang et al.NeurIPS 2023 · 101 citations
- CLIPascene: Scene Sketching with Different Types and Levels of AbstractionYael Vinker, Yuval Alaluf, Daniel Cohen-Or, Ariel ShamirICCV 2023 · 93 citations
- The Animation Transformer: Visual Correspondence via Segment MatchingEvan Casey, Víctor Pérez, Zhuoru LiICCV 2021 · 41 citations
- Partially Does It: Towards Scene-Level FG-SBIR with Partial InputPinaki Nath Chowdhury, Ayan Kumar Bhunia, Viswanatha Reddy Gajjala, Aneeshan Sain et al.CVPR 2022 · 28 citations
- HAIGEN: Towards Human-AI Collaboration for Facilitating Creativity and Style Generation in Fashion DesignJianan Jiang, Di Wu, Hanhui Deng, Yidan Long et al.UbiComp 2024 · 28 citations
Builds on4
- Learning to Paint With Model-Based Deep Reinforcement LearningZhewei Huang, Shuchang Zhou, Wen HengICCV 2019 · 180 citations
- Sketchformer: Transformer-Based Representation for Sketched StructureLeo Sampaio Ferraz Ribeiro, Tu Bui, John P. Collomosse, Moacir PontiCVPR 2020
- Analyzing and Improving the Image Quality of StyleGANTero Karras, Samuli Laine, Miika Aittala, Janne Hellsten et al.CVPR 2020
- SketchyCOCO: Image Generation From Freehand Scene SketchesChengying Gao, Qi Liu, Qi Xu, Limin Wang et al.CVPR 2020
Related papers
- Sketch Your Own GANSheng-Yu Wang, David Bau, Jun-Yan ZhuICCV 2021 · 82 citations
- SketchMan: Learning to Create Professional SketchesJia Li, Nan Gao, Tong Shen, Wei Zhang et al.ACM MM 2020 · 12 citations
- RoboCoDraw: Robotic Avatar Drawing with GAN-Based Style Transfer and Time-Efficient Path OptimizationTianying Wang, Wei Qi Toh, Hao Zhang, Xiuchao Sui et al.AAAI 2020 · 32 citations
- Toward Intelligent Interactive Design: A Generation Framework Based on Cross-domain Fashion ElementsJianyang Shi, Haijun Zhang, Dongliang Zhou, Zhao ZhangACM MM 2023 · 11 citations
- GAN-Based Unpaired Chinese Character Image Translation via Skeleton Transformation and Stroke RenderingYiming Gao, Jiangqin WuAAAI 2020 · 71 citations
