Context-Aware Semantic Inpainting

12/21/2017
by   Haofeng Li, et al.
0

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder architecture with a fully connected layer, which cannot accurately maintain spatial information. In addition, the discriminator in existing GANs struggle to understand high-level semantics within the image context and yield semantically consistent content. Existing evaluation criteria are biased towards blurry results and cannot well characterize edge preservation and visual authenticity in the inpainting results. In this paper, we propose an improved generative adversarial network to overcome the aforementioned limitations. Our proposed GAN-based framework consists of a fully convolutional design for the generator which helps to better preserve spatial structures and a joint loss function with a revised perceptual loss to capture high-level semantics in the context. Furthermore, we also introduce two novel measures to better assess the quality of image inpainting results. Experimental results demonstrate that our method outperforms the state of the art under a wide range of criteria.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 9

page 10

research
03/20/2018

Patch-Based Image Inpainting with Generative Adversarial Networks

Area of image inpainting over relatively large missing regions recently ...
research
02/13/2022

Diverse facial inpainting guided by exemplars

Facial image inpainting is a task of filling visually realistic and sema...
research
11/26/2017

Semantically Consistent Image Completion with Fine-grained Details

Image completion has achieved significant progress due to advances in ge...
research
03/28/2021

Bridging the Visual Gap: Wide-Range Image Blending

In this paper we propose a new problem scenario in image processing, wid...
research
02/11/2022

A Wasserstein GAN for Joint Learning of Inpainting and its Spatial Optimisation

Classic image inpainting is a restoration method that reconstructs missi...
research
03/22/2022

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Recent image inpainting methods have made great progress but often strug...
research
08/19/2019

Boundless: Generative Adversarial Networks for Image Extension

Image extension models have broad applications in image editing, computa...

Please sign up or login with your details

Forgot password? Click here to reset