Inharmonious Region Localization by Magnifying Domain Discrepancy
Jing Liang, Li Niu, Penghao Wu, Fengjun Guo, Teng Long
Abstract
Inharmonious region localization aims to localize the region in a synthetic image which is incompatible with surrounding background. The inharmony issue is mainly attributed to the color and illumination inconsistency produced by image editing techniques. In this work, we tend to transform the input image to another color space to magnify the domain discrepancy between inharmonious region and background, so that the model can identify the inharmonious region more easily. To this end, we present a novel framework consisting of a color mapping module and an inharmonious region localization network, in which the former is equipped with a novel domain discrepancy magnification loss and the latter could be an arbitrary localization network. Extensive experiments on image harmonization dataset show the superiority of our designed framework. Our code is available at https://github.com/bcmi/MadisNet-Inharmonious-Region- Localization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 42d39821-9c3e-4bae-bb28-9eb60b28b3cdCited by top-tier papers2
- Deep Image Harmonization in Dual Color SpacesLinfeng Tan, Jiangtong Li, Li Niu, Liqing ZhangACM MM 2023 · 21 citations
- ChromaFusionNet (CFNet): Natural Fusion of Fine-Grained Color EditingYi Dong, Yuxi Wang, Ruoxi Fan, Wenqi Ouyang et al.AAAI 2024 · 2 citations
Builds on7
- StyleGAN-NADA: CLIP-guided domain adaptation of image generatorsRinon Gal, Or Patashnik, Haggai Maron, Amit H. Bermano et al.SIGGRAPH 2022 · 501 citations
- TransFill: Reference-Guided Image Inpainting by Merging Multiple Color and Spatial TransformationsYuqian Zhou, Connelly Barnes, Eli Shechtman, Sohrab AmirghodsiCVPR 2021
- DoveNet: Deep Image Harmonization via Domain VerificationWenyan Cong, Jianfu Zhang, Li Niu, Liu Liu et al.CVPR 2020
- Zero-Reference Deep Curve Estimation for Low-Light Image EnhancementChunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy et al.CVPR 2020
- Searching Central Difference Convolutional Networks for Face Anti-SpoofingZitong Yu, Chenxu Zhao, Zezheng Wang, Yunxiao Qin et al.CVPR 2020
Related papers
- Intrinsic Image HarmonizationZonghui Guo, Haiyong Zheng, Yufeng Jiang, Zhaorui Gu et al.CVPR 2021
- Painterly Image Harmonization in Dual DomainsJunyan Cao, Yan Hong, Li NiuAAAI 2023 · 27 citations
- Image Harmonization with TransformerZonghui Guo, Dongsheng Guo, Haiyong Zheng, Zhaorui Gu et al.ICCV 2021 · 95 citations
- Deep Image Harmonization with Learnable AugmentationLi Niu, Junyan Cao, Wenyan Cong, Liqing ZhangICCV 2023 · 13 citations
- Interactive Portrait HarmonizationJeya Maria Jose Valanarasu, He Zhang, Jianming Zhang, Yilin Wang et al.ICLR 2023 · 7 citations
