Controllable Artistic Text Style Transfer via Shape-Matching GAN
Shuai Yang, Zhangyang Wang, Zhaowen Wang, Ning Xu, Jiaying Liu, Zongming Guo
Abstract
Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling the stylistic degree in terms of shape deformation remains an important open challenge. In this paper, we present the first text style transfer network that allows for real-time control of the crucial stylistic degree of the glyph through an adjustable parameter. Our key contribution is a novel bidirectional shape matching framework to establish an effective glyph-style mapping at various deformation levels without paired ground truth. Based on this idea, we propose a scale-controllable module to empower a single network to continuously characterize the multi-scale shape features of the style image and transfer these features to the target text. The proposed method demonstrates its superiority over previous state-of-the-arts in generating diverse, controllable and high-quality stylized text.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b2b0e5ef-6f96-42ac-8258-4d82cc027b83Cited by top-tier papers25
- TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale UpYifan Jiang, Shiyu Chang, Zhangyang WangNeurIPS 2021 · 515 citations
- AutoGAN: Neural Architecture Search for Generative Adversarial NetworksXinyu Gong, Shiyu Chang, Yifan Jiang, Zhangyang WangICCV 2019 · 286 citations
- Versatile Diffusion: Text, Images and Variations All in One Diffusion ModelXingqian Xu, Zhangyang Wang, Eric J. Zhang, Kai Wang et al.ICCV 2023 · 265 citations
- Rebooting ACGAN: Auxiliary Classifier GANs with Stable TrainingMinguk Kang, Woohyeon Shim, Minsu Cho, Jaesik ParkNeurIPS 2021 · 145 citations
- SSH: A Self-Supervised Framework for Image HarmonizationYifan Jiang, He Zhang, Jianming Zhang, Yilin Wang et al.ICCV 2021 · 108 citations
Builds on1
Related papers
- TextMaster: A Unified Framework for Realistic Text Editing via Glyph-Style Dual-ControlZhenyu Yan, Jian Wang, Aoqiang Wang, Yuhan Li et al.ICCV 2025 · 4 citations
- DG-Font: Deformable Generative Networks for Unsupervised Font GenerationYangchen Xie, Xinyuan Chen, Li Sun, Yue LuCVPR 2021
- Interactive Image Style Transfer Guided by GraffitiQuan Wang, Yanli Ren, Xinpeng Zhang, Guorui FengACM MM 2023 · 5 citations
- TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance ControlWeichao Zeng, Yan Shu, Zhenhang Li, Dongbao Yang et al.NeurIPS 2024 · 55 citations
- SwapText: Image Based Texts Transfer in ScenesQiangpeng Yang, Jun Huang, Wei LinCVPR 2020
