ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows
Jie An, Siyu Huang, Yibing Song, Dejing Dou, Wei Liu, Jiebo Luo
Abstract
Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not aware of the content leak phenomenon that the image content may corrupt after several rounds of stylization process. In this paper, we propose ArtFlow to prevent content leak during universal style transfer. ArtFlow consists of reversible neural flows and an unbiased feature transfer module. It supports both forward and backward inferences and operates in a projection-transfer-reversion scheme. The forward inference projects input images into deep features, while the backward inference remaps deep features back to input images in a lossless and unbiased way. Extensive experiments demonstrate that ArtFlow achieves comparable performance to state-of-the-art style transfer methods while avoiding content leak.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers46
- StyTr2: Image Style Transfer with TransformersYingying Deng, Fan Tang, Weiming Dong, Chongyang Ma et al.CVPR 2022 · 345 citations
- StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion ModelsZhizhong Wang, Lei Zhao, Wei XingICCV 2023 · 219 citations
- Domain Enhanced Arbitrary Image Style Transfer via Contrastive LearningYuxin Zhang, Fan Tang, Weiming Dong, Haibin Huang et al.SIGGRAPH 2022 · 211 citations
- Wavelet Knowledge Distillation: Towards Efficient Image-to-Image TranslationLinfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan et al.CVPR 2022 · 105 citations
- AesUST: Towards Aesthetic-Enhanced Universal Style TransferZhizhong Wang, Zhanjie Zhang, Lei Zhao, Zhiwen Zuo et al.ACM MM 2022 · 70 citations
Builds on8
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment SearchJaehyeon Kim, Sungwon Kim, Jungil Kong, Sungroh YoonNeurIPS 2020 · 663 citations
- Photorealistic Style Transfer via Wavelet TransformsJaejun Yoo, Youngjung Uh, Sanghyuk Chun, Byeongkyu Kang et al.ICCV 2019 · 412 citations
- Dynamic Instance Normalization for Arbitrary Style TransferYongcheng Jing, Xiao Liu, Yukang Ding, Xinchao Wang et al.AAAI 2020 · 212 citations
- A Closed-Form Solution to Universal Style TransferMing Lu, Hao Zhao, Anbang Yao, Yurong Chen et al.ICCV 2019 · 91 citations
Related papers
- Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo CartoonizationJieun Lee, Hyeonwoo Kim, Jonghwa Shim, Eenjun HwangACM MM 2022 · 14 citations
- Autoregressive Stylized Motion Synthesis With Generative FlowYu-Hui Wen, Zhipeng Yang, Hongbo Fu, Lin Gao et al.CVPR 2021
- Domain-Aware Universal Style TransferKibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu et al.ICCV 2021 · 77 citations
- Artistic Style Transfer with Internal-external Learning and Contrastive LearningHaibo Chen, Lei Zhao, Zhizhong Wang, Huiming Zhang et al.NeurIPS 2021 · 243 citations
- Diversified Arbitrary Style Transfer via Deep Feature PerturbationZhizhong Wang, Lei Zhao, Haibo Chen, Lihong Qiu et al.CVPR 2020
