FontRL: Chinese Font Synthesis via Deep Reinforcement Learning
Yitian Liu, Zhouhui Lian
Abstract
Automatic generation of Chinese fonts is a valuable but challenging task in areas of AI and Computer Graphics, mainly due to the huge amount of Chinese characters and their complex glyph structures. In this paper, we propose FontRL, a novel method for Chinese font synthesis by using deep reinforcement learning. Specifically, we first train a deep reinforcement learning model to obtain the Thin-Plate Spline (TPS) transformation that is able to modify the reference stroke skeleton in a mean font style into the skeleton of a required style for each stroke of every unseen Chinese character. Afterwards, we utilize a CNN model to predict the location and scale information of these strokes, and then assemble them to get the skeleton of the corresponding character. Finally, we convert each synthesized character skeleton into the glyph image via an image-to-image translation model. Both quantitative and qualitative experimental results demonstrate the superiority of the proposed FontRL compared to the state of the art. Our code is available at https://github.com/lsflyt-pku/FontRL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 58ff12fd-09d8-4cd5-9a14-336380173552Cited by top-tier papers3
- IF-Font: Ideographic Description Sequence-Following Font GenerationXinping Chen, Xiao Ke, Wenzhong GuoNeurIPS 2024 · 13 citations
- DeepCalliFont: Few-Shot Chinese Calligraphy Font Synthesis by Integrating Dual-Modality Generative ModelsYitian Liu, Zhouhui LianAAAI 2024 · 12 citations
- Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image RegistrationMeng Li, Yahan Yu, Yi Yang, Guanghao Ren et al.AAAI 2023 · 7 citations
Builds on1
Related papers
- GAN-Based Unpaired Chinese Character Image Translation via Skeleton Transformation and Stroke RenderingYiming Gao, Jiangqin WuAAAI 2020 · 71 citations
- ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer ApproachQi Wen, Shuang Li, Bingfeng Han, Yi YuanACM MM 2021 · 42 citations
- XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font GenerationWei Liu, Fangyue Liu, Fei Ding, Qian He et al.CVPR 2022 · 64 citations
- VQ-FONT: Few-Shot Font Generation with Structure-Aware Enhancement and QuantizationMingshuai Yao, Yabo Zhang, Xianhui Lin, Xiaoming Li et al.AAAI 2024 · 26 citations
- Few-shot Font Generation with Localized Style Representations and FactorizationSong Park, Sanghyuk Chun, Junbum Cha, Bado Lee et al.AAAI 2021 · 111 citations
