Painterly Image Harmonization by Learning from Painterly Objects
Li Niu, Junyan Cao, Yan Hong, Liqing Zhang
Abstract
Given a composite image with photographic object and painterly background, painterly image harmonization targets at stylizing the composite object to be compatible with the background. Despite the competitive performance of existing painterly harmonization works, they did not fully leverage the painterly objects in artistic paintings. In this work, we explore learning from painterly objects for painterly image harmonization. In particular, we learn a mapping from background style and object information to object style based on painterly objects in artistic paintings. With the learnt mapping, we can hallucinate the target style of composite object, which is used to harmonize encoder feature maps to produce the harmonized image. Extensive experiments on the benchmark dataset demonstrate the effectiveness of our proposed method. Dataset and code are available at https://github.com/ bcmi/ArtoPIH-Painterly-Image-Harmonization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f964bfca-ae31-47bb-9865-fcc72b258c52Cited by top-tier papers1
Ask how each one uses itBuilds on18
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song et al.ICLR 2022 · 2,128 citations
- AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style TransferSonghua Liu, Tianwei Lin, Dongliang He, Fu Li et al.ICCV 2021 · 421 citations
- StyTr2: Image Style Transfer with TransformersYingying Deng, Fan Tang, Weiming Dong, Chongyang Ma et al.CVPR 2022 · 345 citations
- Dynamic Instance Normalization for Arbitrary Style TransferYongcheng Jing, Xiao Liu, Yukang Ding, Xinchao Wang et al.AAAI 2020 · 212 citations
- SSH: A Self-Supervised Framework for Image HarmonizationYifan Jiang, He Zhang, Jianming Zhang, Yilin Wang et al.ICCV 2021 · 108 citations
Related papers
- Progressive Painterly Image Harmonization from Low-Level Styles to High-Level StylesLi Niu, Yan Hong, Junyan Cao, Liqing ZhangAAAI 2024 · 3 citations
- Painterly Image Harmonization in Dual DomainsJunyan Cao, Yan Hong, Li NiuAAAI 2023 · 27 citations
- Painterly Image Harmonization using Diffusion ModelLingxiao Lu, Jiangtong Li, Junyan Cao, Li Niu et al.ACM MM 2023 · 19 citations
- FreePIH: Training-Free Painterly Image Harmonization with Diffusion ModelRuibin Li, Jingcai Guo, Qihua Zhou, Song GuoACM MM 2024 · 2 citations
- Training-and-Prompt-Free General Painterly Harmonization via Zero-Shot Disentenglement on Style and Content ReferencesTeng-Fang Hsiao, Bo-Kai Ruan, Hong-Han ShuaiAAAI 2025 · 6 citations
