Semi-supervised reference-based sketch extraction using a contrastive learning framework
Chang Wook Seo, Amirsaman Ashtari, Junyong Noh
摘要
Sketches reflect the drawing style of individual artists; therefore, it is important to consider their unique styles when extracting sketches from color images for various applications. Unfortunately, most existing sketch extraction methods are designed to extract sketches of a single style. Although there have been some attempts to generate various style sketches, the methods generally suffer from two limitations: low quality results and difficulty in training the model due to the requirement of a paired dataset. In this paper, we propose a novel multi-modal sketch extraction method that can imitate the style of a given reference sketch with unpaired data training in a semi-supervised manner. Our method outperforms state-of-the-art sketch extraction methods and unpaired image translation methods in both quantitative and qualitative evaluations.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- One-Shot Reference-based Structure-Aware Image to Sketch SynthesisRui Yang, Honghong Yang, Li Zhao, Qin Lei 等AAAI 2025 · 被引用 2 次
- Stroke2Sketch: Harnessing Stroke Attributes for Training-Free Sketch GenerationRui Yang, Huining Li, Yiyi Long, Xiaojun Wu 等ICCV 2025 · 被引用 2 次
- Text to Sketch Generation with Multi-StylesTengjie Li, Shikui Tu, Lei XuNeurIPS 2025 · 被引用 1 次
它引用的顶会 Paper21
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Swapping Autoencoder for Deep Image ManipulationTaesung Park, Jun-Yan Zhu, Oliver Wang, Jingwan Lu 等NeurIPS 2020 · 被引用 376 次
- You Only Need Adversarial Supervision for Semantic Image SynthesisEdgar Schönfeld, Vadim Sushko, Dan Zhang, Juergen Gall 等ICLR 2021 · 被引用 219 次
- CLIPasso: semantically-aware object sketchingYael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo, Roman Christian Bachmann 等SIGGRAPH 2022 · 被引用 219 次
相关 Paper
- Learning to generate line drawings that convey geometry and semanticsCaroline Chan, Frédo Durand, Phillip IsolaCVPR 2022 · 被引用 86 次
- Reference-Based Sketch Image Colorization Using Augmented-Self Reference and Dense Semantic CorrespondenceJunsoo Lee, Eungyeup Kim, Yunsung Lee, Dongjun Kim 等CVPR 2020
- Integrating Categorical Semantics into Unsupervised Domain TranslationSamuel Lavoie-Marchildon, Faruk Ahmed, Aaron C. CourvilleICLR 2021 · 被引用 7 次
- Self-Supervised Sketch-to-Image SynthesisBingchen Liu, Yizhe Zhu, Kunpeng Song, Ahmed ElgammalAAAI 2021 · 被引用 46 次
- MaskSketch: Unpaired Structure-guided Masked Image GenerationDina Bashkirova, José Lezama, Kihyuk Sohn, Kate Saenko 等CVPR 2023
