Image Inpainting With External-Internal Learning and Monochromic Bottleneck
Tengfei Wang, Hao Ouyang, Qifeng Chen
Abstract
Although recent inpainting approaches have demonstrated significant improvement with deep neural networks, they still suffer from artifacts such as blunt structures and abrupt colors when filling in the missing regions. To address these issues, we propose an external-internal inpainting scheme with a monochromic bottleneck that helps image inpainting models remove these artifacts. In the external learning stage, we reconstruct missing structures and details in the monochromic space to reduce the learning dimension. In the internal learning stage, we propose a novel internal color propagation method with progressive learning strategies for consistent color restoration. Extensive experiments demonstrate that our proposed scheme helps image inpainting models produce more structure-preserved and visually compelling results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e4206411-d42d-4db2-824f-916e2ca57ce7Cited by top-tier papers14
- Artistic Style Transfer with Internal-external Learning and Contrastive LearningHaibo Chen, Lei Zhao, Zhizhong Wang, Huiming Zhang et al.NeurIPS 2021 · 243 citations
- Dual-Camera Super-Resolution with Aligned Attention ModulesTengfei Wang, Jiaxin Xie, Wenxiu Sun, Qiong Yan et al.ICCV 2021 · 58 citations
- Rethinking Fast Fourier Convolution in Image InpaintingTianyi Chu, Jiafu Chen, Jiakai Sun, Shuobin Lian et al.ICCV 2023 · 54 citations
- Internal Video Inpainting by Implicit Long-range PropagationHao Ouyang, Tengfei Wang, Qifeng ChenICCV 2021 · 42 citations
- Partially Does It: Towards Scene-Level FG-SBIR with Partial InputPinaki Nath Chowdhury, Ayan Kumar Bhunia, Viswanatha Reddy Gajjala, Aneeshan Sain et al.CVPR 2022 · 28 citations
Builds on6
- Free-Form Image Inpainting With Gated ConvolutionJiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen et al.ICCV 2019 · 1,990 citations
- SinGAN: Learning a Generative Model From a Single Natural ImageTamar Rott Shaham, Tali Dekel, Tomer MichaeliICCV 2019 · 933 citations
- Everybody Dance NowCaroline Chan, Shiry Ginosar, Tinghui Zhou, Alexei A. EfrosICCV 2019 · 840 citations
- StructureFlow: Image Inpainting via Structure-Aware Appearance FlowYurui Ren, Xiaoming Yu, Ruonan Zhang, Thomas H. Li et al.ICCV 2019 · 356 citations
- Progressive Reconstruction of Visual Structure for Image InpaintingJingyuan Li, Fengxiang He, Lefei Zhang, Bo Du et al.ICCV 2019 · 151 citations
Related papers
- Cycle-CNN for Colorization towards Real Monochrome-Color Camera SystemsXuan Dong, Weixin Li, Xiaojie Wang, Yunhong WangAAAI 2020 · 11 citations
- Localization of Deep Inpainting Using High-Pass Fully Convolutional NetworkHaodong Li, Jiwu HuangICCV 2019 · 157 citations
- Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional EncodingQiaole Dong, Chenjie Cao, Yanwei FuCVPR 2022 · 194 citations
- Image Inpainting With Learnable Bidirectional Attention MapsChaohao Xie, Shaohui Liu, Chao Li, Ming-Ming Cheng et al.ICCV 2019 · 255 citations
- Learning to Incorporate Structure Knowledge for Image InpaintingJie Yang, Zhiquan Qi, Yong ShiAAAI 2020 · 141 citations
