DualAST: Dual Style-Learning Networks for Artistic Style Transfer
Haibo Chen, Lei Zhao, Zhizhong Wang, Huiming Zhang, Zhiwen Zuo, Ailin Li, Wei Xing, Dongming Lu
Abstract
Artistic style transfer is an image editing task that aims at repainting everyday photographs with learned artistic styles. Existing methods learn styles from either a single style example or a collection of artworks. Accordingly, the stylization results are either inferior in visual quality or limited in style controllability. To tackle this problem, we propose a novel Dual Style-Learning Artistic Style Transfer (DualAST) framework to learn simultaneously both the holistic artist-style (from a collection of artworks) and the specific artwork-style (from a single style image): the artist-style sets the tone (i.e., the overall feeling) for the stylized image, while the artwork-style determines the details of the stylized image, such as color and texture. Moreover, we introduce a Style-Control Block (SCB) to adjust the styles of generated images with a set of learnable style-control factors. We conduct extensive experiments to evaluate the performance of the proposed framework, the results of which confirm the superiority of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers14
- Artistic Style Transfer with Internal-external Learning and Contrastive LearningHaibo Chen, Lei Zhao, Zhizhong Wang, Huiming Zhang et al.NeurIPS 2021 · 243 citations
- StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion ModelsZhizhong Wang, Lei Zhao, Wei XingICCV 2023 · 219 citations
- Wavelet Knowledge Distillation: Towards Efficient Image-to-Image TranslationLinfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan et al.CVPR 2022 · 105 citations
- AesUST: Towards Aesthetic-Enhanced Universal Style TransferZhizhong Wang, Zhanjie Zhang, Lei Zhao, Zhiwen Zuo et al.ACM MM 2022 · 70 citations
- MicroAST: Towards Super-fast Ultra-Resolution Arbitrary Style TransferZhizhong Wang, Lei Zhao, Zhiwen Zuo, Ailin Li et al.AAAI 2023 · 68 citations
Builds on10
- Content and Style Disentanglement for Artistic Style TransferDmytro Kotovenko, Artsiom Sanakoyeu, Sabine Lang, Björn OmmerICCV 2019 · 187 citations
- Multimodal Style Transfer via Graph CutsYulun Zhang, Chen Fang, Yilin Wang, Zhaowen Wang et al.ICCV 2019 · 92 citations
- A Closed-Form Solution to Universal Style TransferMing Lu, Hao Zhao, Anbang Yao, Yurong Chen et al.ICCV 2019 · 91 citations
- EFANet: Exchangeable Feature Alignment Network for Arbitrary Style TransferZhijie Wu, Chunjin Song, Yang Zhou, Minglun Gong et al.AAAI 2020 · 33 citations
- UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space TranslationLei Zhao, Qihang Mo, Sihuan Lin, Zhizhong Wang et al.CVPR 2020
Related papers
- TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style TransferHaibo Chen, Lei Zhao, Jun Li, Jian YangACM MM 2023 · 21 citations
- ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt BankZhanjie Zhang, Quanwei Zhang, Wei Xing, Guangyuan Li et al.AAAI 2024 · 32 citations
- Diverse Image Style Transfer via Invertible Cross-Space MappingHaibo Chen, Lei Zhao, Huiming Zhang, Zhizhong Wang et al.ICCV 2021 · 42 citations
- Pastiche Master: Exemplar-Based High-Resolution Portrait Style TransferShuai Yang, Liming Jiang, Ziwei Liu, Chen Change LoyCVPR 2022 · 130 citations
- Inversion-based Style Transfer with Diffusion ModelsYuxin Zhang, Nisha Huang, Fan Tang, Haibin Huang et al.CVPR 2023
