Interactive Cartoonization with Controllable Perceptual Factors
Namhyuk Ahn, Patrick Kwon, Jihye Back, Kibeom Hong, Seungkwon Kim
Abstract
Cartoonization is a task that renders natural photos into cartoon styles. Previous deep cartoonization methods only have focused on end-to-end translation, which may hinder editability. Instead, we propose a novel solution with editing features of texture and color based on the cartoon creation process. To do that, we design a model architecture to have separate decoders, texture and color, to decouple these attributes. In the texture decoder, we propose a texture controller, which enables a user to control stroke style and abstraction to generate diverse cartoon textures. We also introduce an HSV color augmentation to induce the networks to generate diverse and controllable color translation. To the best of our knowledge, our work is the first deep approach to control the cartoonization at inference while showing profound quality improvement over to baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9afcfe9f-e869-4090-a805-58497785ac03Cited by top-tier papers2
- DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion ModelsNamhyuk Ahn, Junsoo Lee, Chunggi Lee, Kunhee Kim et al.AAAI 2024 · 51 citations
- Private Gradient Estimation is Useful for Generative ModelingBochao Liu, Pengju Wang, Weijia Guo, Yong Li et al.ACM MM 2024 · 1 citation
Builds on3
- Learning to Cartoonize Using White-Box Cartoon RepresentationsXinrui Wang, Jinze YuCVPR 2020
- StarGAN v2: Diverse Image Synthesis for Multiple DomainsYunjey Choi, Youngjung Uh, Jaejun Yoo, Jung-Woo HaCVPR 2020
- Rethinking Style Transfer: From Pixels to Parameterized BrushstrokesDmytro Kotovenko, Matthias Wright, Arthur Heimbrecht, Björn OmmerCVPR 2021
Related papers
- Learning to Incorporate Texture Saliency Adaptive Attention to Image CartoonizationXiang Gao, Yuqi Zhang, Yingjie TianICML 2022 · 16 citations
- Unpaired Cartoon Image Synthesis via Gated Cycle MappingYifang Men, Yuan Yao, Miaomiao Cui, Zhouhui Lian et al.CVPR 2022 · 19 citations
- CariPainter: Sketch Guided Interactive Caricature GenerationXin Huang, Dong Liang, Hongrui Cai, Juyong Zhang et al.ACM MM 2022 · 5 citations
- Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo CartoonizationJieun Lee, Hyeonwoo Kim, Jonghwa Shim, Eenjun HwangACM MM 2022 · 14 citations
- DeepFacePencil: Creating Face Images from Freehand SketchesYuhang Li, Xuejin Chen, Binxin Yang, Zihan Chen et al.ACM MM 2020 · 56 citations
