Lune

ACM MM2020Top-tier venue

SketchMan: Learning to Create Professional Sketches

Jia Li, Nan Gao, Tong Shen, Wei Zhang, Tao Mei, Hui Ren

Abstract

Human free-hand sketches have been studied in various fields including sketch recognition, synthesis and sketch-based image retrieval. We propose a new challenging task sketch enhancement (SE) defined in an ill-posed space, i.e. enhancing a non-professional sketch (NPS) to a professional sketch (PS), which is a creative generation task different from sketch abstraction, sketch completion and sketch variation. For the first time we release a database of NPS with PS for anime characters. We cast sketch enhancement as an image-to-image translation problem by exploiting the relationship to corresponding intensive or sparse pixel domains for sketch domain. Specifically, we explore three different routines based on conditional generative adversarial network (cGAN), i.e. Sketch-Sketch (SS), Sketch-Colorization-Sketch (SCS) and Sketch-Abstraction-Sketch (SAS). SS is a one-stage model that directly maps NPS to PS, while SCS and SAS are two-stage models where auxiliary inputs, grayscale parsing and shape parsing, are involved. Multiple metrics are used to evaluate the performance of the models in both the sketch domain and other low-level feature domains. With quantitative and qualitative analysis of the experiments, we have established solid baselines, which, we hope, could encourage more research conducted on this task. Our dataset is publicly available via https://github.com/LCXCUC/SketchMan2020.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

its abstract · related work

Get the answer

Free to start. No credit card required.

Related papers

  1. AniFaceDrawing: Anime Portrait Exploration during Your SketchingZhengyu Huang, Haoran Xie, Tsukasa Fukusato, Kazunori MiyataSIGGRAPH 2023 · 24 citations
  2. SketchEdit: Mask-Free Local Image Manipulation with Partial SketchesYu Zeng, Zhe Lin, Vishal M. PatelCVPR 2022 · 50 citations
  3. Fashion Editing With Adversarial Parsing LearningHaoye Dong, Xiaodan Liang, Yixuan Zhang, Xujie Zhang et al.CVPR 2020
  4. Reference-Based Sketch Image Colorization Using Augmented-Self Reference and Dense Semantic CorrespondenceJunsoo Lee, Eungyeup Kim, Yunsung Lee, Dongjun Kim et al.CVPR 2020
  5. SketchAA: Abstract Representation for Abstract SketchesLan Yang, Kaiyue Pang, Honggang Zhang, Yi-Zhe SongICCV 2021 · 26 citations
Dusk over the sea between two cliffs drawn in fine vertical lines