DeepAI AI Chat
Log In Sign Up

Image Inpainting via Conditional Texture and Structure Dual Generation

08/22/2021
by   Xiefan Guo, et al.
Beihang University
1

Deep generative approaches have recently made considerable progress in image inpainting by introducing structure priors. Due to the lack of proper interaction with image texture during structure reconstruction, however, current solutions are incompetent in handling the cases with large corruptions, and they generally suffer from distorted results. In this paper, we propose a novel two-stream network for image inpainting, which models the structure-constrained texture synthesis and texture-guided structure reconstruction in a coupled manner so that they better leverage each other for more plausible generation. Furthermore, to enhance the global consistency, a Bi-directional Gated Feature Fusion (Bi-GFF) module is designed to exchange and combine the structure and texture information and a Contextual Feature Aggregation (CFA) module is developed to refine the generated contents by region affinity learning and multi-scale feature aggregation. Qualitative and quantitative experiments on the CelebA, Paris StreetView and Places2 datasets demonstrate the superiority of the proposed method. Our code is available at https://github.com/Xiefan-Guo/CTSDG.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 7

page 8

page 9

05/21/2022

Multi-feature Co-learning for Image Inpainting

Image inpainting has achieved great advances by simultaneously leveragin...
07/29/2022

Reference-Guided Texture and Structure Inference for Image Inpainting

Existing learning-based image inpainting methods are still in challenge ...
09/17/2022

Delving Globally into Texture and Structure for Image Inpainting

Image inpainting has achieved remarkable progress and inspired abundant ...
03/18/2021

Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE

Given an incomplete image without additional constraint, image inpaintin...
01/13/2020

Natural Image Matting via Guided Contextual Attention

Over the last few years, deep learning based approaches have achieved ou...
01/12/2020

Concurrently Extrapolating and Interpolating Networks for Continuous Model Generation

Most deep image smoothing operators are always trained repetitively when...
02/23/2022

Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Images

Inpainting shadowed regions cast by superficial blood vessels in retinal...