EFANet: Exchangeable Feature Alignment Network for Arbitrary Style Transfer
Zhijie Wu, Chunjin Song, Yang Zhou, Minglun Gong, Hui Huang
Abstract
Style transfer has been an important topic both in computer vision and graphics. Since the seminal work of Gatys et al. first demonstrates the power of stylization through optimization in the deep feature space, quite a few approaches have achieved real-time arbitrary style transfer with straightforward statistic matching techniques. In this work, our key observation is that only considering features in the input style image for the global deep feature statistic matching or local patch swap may not always ensure a satisfactory style transfer; see e.g., Figure 1 . Instead, we propose a novel transfer framework, EFANet, that aims to jointly analyze and better align exchangeable features extracted from content and style image pair. In this way, the style features from the style image seek for the best compatibility with the content information in the content image, leading to more structured stylization results. In addition, a new whitening loss is developed for purifying the computed content features and better fusion with styles in feature space. Qualitative and quantitative experiments demonstrate the advantages of our approach. * Equal contribution. Order determined by coin toss.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style TransferSonghua Liu, Tianwei Lin, Dongliang He, Fu Li et al.ICCV 2021 · 421 citations
- StyTr2: Image Style Transfer with TransformersYingying Deng, Fan Tang, Weiming Dong, Chongyang Ma et al.CVPR 2022 · 345 citations
- General Image-to-Image Translation with One-Shot Image GuidanceBin Cheng, Zuhao Liu, Yunbo Peng, Yue LinICCV 2023 · 60 citations
- Diverse Image Style Transfer via Invertible Cross-Space MappingHaibo Chen, Lei Zhao, Huiming Zhang, Zhizhong Wang et al.ICCV 2021 · 42 citations
- TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style TransferHaibo Chen, Lei Zhao, Jun Li, Jian YangACM MM 2023 · 21 citations
Related papers
- Arbitrary Video Style Transfer via Multi-Channel CorrelationYingying Deng, Fan Tang, Weiming Dong, Haibin Huang et al.AAAI 2021 · 197 citations
- Domain Enhanced Arbitrary Image Style Transfer via Contrastive LearningYuxin Zhang, Fan Tang, Weiming Dong, Haibin Huang et al.SIGGRAPH 2022 · 211 citations
- Diversified Arbitrary Style Transfer via Deep Feature PerturbationZhizhong Wang, Lei Zhao, Haibo Chen, Lihong Qiu et al.CVPR 2020
- Artistic Style Transfer with Internal-external Learning and Contrastive LearningHaibo Chen, Lei Zhao, Zhizhong Wang, Huiming Zhang et al.NeurIPS 2021 · 243 citations
- A Closed-Form Solution to Universal Style TransferMing Lu, Hao Zhao, Anbang Yao, Yurong Chen et al.ICCV 2019 · 91 citations
