Artistic Style Discovery with Independent Components
Xin Xie, Yi Li, Huaibo Huang, Haiyan Fu, Wanwan Wang, Yanqing Guo
Abstract
Style transfer has been well studied in recent years with excellent performance processed. While existing methods usually choose CNNs as the powerful tool to accomplish superb stylization, less attention was paid to the latent style space. Rare exploration of underlying dimensions results in the poor style controllability and the limited practical application. In this work, we rethink the internal meaning of style features, further proposing a novel unsupervised algorithm for style discovery and achieving personalized manip-ulation. In particular, we take a closer look into the mechanism of style transfer and obtain different artistic style components from the latent space consisting of different style features. Then fresh styles can be generated by linear combination according to various style components. Experimental results have shown that our approach is superb in 1) restylizing the original output with the diverse artistic styles discovered from the latent space while keeping the content unchanged, and 2) being generic and compatible for various style transfer methods. Our code is available in this page: https://github.com/Shelsin/ArtIns.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- MicroAST: Towards Super-fast Ultra-Resolution Arbitrary Style TransferZhizhong Wang, Lei Zhao, Zhiwen Zuo, Ailin Li et al.AAAI 2023 · 68 citations
- User-Controllable Arbitrary Style Transfer via Entropy RegularizationJiaxin Cheng, Yue Wu, Ayush Jaiswal, Xu Zhang et al.AAAI 2023 · 10 citations
- ZePo: Zero-Shot Portrait Stylization with Faster SamplingJin Liu, Huaibo Huang, Jie Cao, Ran HeACM MM 2024 · 6 citations
Builds on5
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
- Multimodal Style Transfer via Graph CutsYulun Zhang, Chen Fang, Yilin Wang, Zhaowen Wang et al.ICCV 2019 · 92 citations
- Closed-Form Factorization of Latent Semantics in GANsYujun Shen, Bolei ZhouCVPR 2021
- Interpreting the Latent Space of GANs for Semantic Face EditingYujun Shen, Jinjin Gu, Xiaoou Tang, Bolei ZhouCVPR 2020
- L2M-GAN: Learning To Manipulate Latent Space Semantics for Facial Attribute EditingGuoxing Yang, Nanyi Fei, Mingyu Ding, Guangzhen Liu et al.CVPR 2021
Related papers
- Retrieve in Style: Unsupervised Facial Feature Transfer and RetrievalMin Jin Chong, Wen-Sheng Chu, Abhishek Kumar, David A. ForsythICCV 2021 · 27 citations
- Diverse Image Style Transfer via Invertible Cross-Space MappingHaibo Chen, Lei Zhao, Huiming Zhang, Zhizhong Wang et al.ICCV 2021 · 42 citations
- Understanding Generalized Whitening and Coloring Transform for Universal Style TransferTai-Yin ChiuICCV 2019 · 32 citations
- ArtFlow: Unbiased Image Style Transfer via Reversible Neural FlowsJie An, Siyu Huang, Yibing Song, Dejing Dou et al.CVPR 2021
- Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion NetworkSizhe Zheng, Pan Gao, Peng Zhou, Jie QinCVPR 2024 · 20 citations
