StructureFlow: Image Inpainting via Structure-Aware Appearance Flow
Yurui Ren, Xiaoming Yu, Ruonan Zhang, Thomas H. Li, Shan Liu, Ge Li
Abstract
Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this problem, in this paper, we propose a two-stage model which splits the inpainting task into two parts: structure reconstruction and texture generation. In the first stage, edge-preserved smooth images are employed to train a structure reconstructor which completes the missing structures of the inputs. In the second stage, based on the reconstructed structures, a texture generator using appearance flow is designed to yield image details. Experiments on multiple publicly available datasets show the superior performance of the proposed network.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers66
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- RePaint: Inpainting using Denoising Diffusion Probabilistic ModelsAndreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu et al.CVPR 2022 · 1,425 citations
- MAT: Mask-Aware Transformer for Large Hole Image InpaintingWenbo Li, Zhe Lin, Kun Zhou, Lu Qi et al.CVPR 2022 · 382 citations
- Large Scale Image Completion via Co-Modulated Generative Adversarial NetworksShengyu Zhao, Jonathan Cui, Yilun Sheng, Yue Dong et al.ICLR 2021 · 348 citations
- TextDiffuser: Diffusion Models as Text PaintersJingye Chen, Yupan Huang, Tengchao Lv, Lei Cui et al.NeurIPS 2023 · 290 citations
Builds on1
Related papers
- Image Inpainting via Conditional Texture and Structure Dual GenerationXiefan Guo, Hongyu Yang, Di HuangICCV 2021 · 283 citations
- Parallel Multi-Resolution Fusion Network for Image InpaintingWentao Wang, Jianfu Zhang, Li Niu, Haoyu Ling et al.ICCV 2021 · 28 citations
- JPGNet: Joint Predictive Filtering and Generative Network for Image InpaintingQing Guo, Xiaoguang Li, Felix Juefei-Xu, Hongkai Yu et al.ACM MM 2021 · 34 citations
- Image Inpainting Based on Multi-frequency Probabilistic Inference ModelJin Wang, Chen Wang, Qingming Huang, Yunhui Shi et al.ACM MM 2020 · 7 citations
- An Internal Learning Approach to Video InpaintingHaotian Zhang, Long Mai, Hailin Jin, Zhaowen Wang et al.ICCV 2019 · 77 citations
