DeepAI AI Chat
Log In Sign Up

Image Inpainting via Conditional Texture and Structure Dual Generation

by   Xiefan Guo, et al.
Beihang University

Deep generative approaches have recently made considerable progress in image inpainting by introducing structure priors. Due to the lack of proper interaction with image texture during structure reconstruction, however, current solutions are incompetent in handling the cases with large corruptions, and they generally suffer from distorted results. In this paper, we propose a novel two-stream network for image inpainting, which models the structure-constrained texture synthesis and texture-guided structure reconstruction in a coupled manner so that they better leverage each other for more plausible generation. Furthermore, to enhance the global consistency, a Bi-directional Gated Feature Fusion (Bi-GFF) module is designed to exchange and combine the structure and texture information and a Contextual Feature Aggregation (CFA) module is developed to refine the generated contents by region affinity learning and multi-scale feature aggregation. Qualitative and quantitative experiments on the CelebA, Paris StreetView and Places2 datasets demonstrate the superiority of the proposed method. Our code is available at


page 1

page 2

page 3

page 4

page 5

page 7

page 8

page 9


Multi-feature Co-learning for Image Inpainting

Image inpainting has achieved great advances by simultaneously leveragin...

Reference-Guided Texture and Structure Inference for Image Inpainting

Existing learning-based image inpainting methods are still in challenge ...

Delving Globally into Texture and Structure for Image Inpainting

Image inpainting has achieved remarkable progress and inspired abundant ...

Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE

Given an incomplete image without additional constraint, image inpaintin...

Natural Image Matting via Guided Contextual Attention

Over the last few years, deep learning based approaches have achieved ou...

Concurrently Extrapolating and Interpolating Networks for Continuous Model Generation

Most deep image smoothing operators are always trained repetitively when...

Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Images

Inpainting shadowed regions cast by superficial blood vessels in retinal...