Learning to Inpaint by Progressively Growing the Mask Regions

02/21/2020
by   Mohamed Abbas Hedjazi, et al.
7

Image inpainting is one of the most challenging tasks in computer vision. Recently, generative-based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to generate the correct structures and colors as the masked region grows large. This drawback is due to the training stability issue of the generative models. This work introduces a new curriculum-style training approach in the context of image inpainting. The proposed method increases the masked region size progressively in training time, during test time the user gives variable size and multiple holes at arbitrary locations. Incorporating such an approach in GANs may stabilize the training and provides better color consistencies and captures object continuities. We validate our approach on the MSCOCO and CelebA datasets. We report qualitative and quantitative comparisons of our training approach in different models.

READ FULL TEXT

page 3

page 6

page 7

page 10

research
05/04/2022

An Analysis of Generative Methods for Multiple Image Inpainting

Image inpainting refers to the restoration of an image with missing regi...
research
01/24/2018

Generative Image Inpainting with Contextual Attention

Recent deep learning based approaches have shown promising results on im...
research
09/13/2012

Hirarchical Digital Image Inpainting Using Wavelets

Inpainting is the technique of reconstructing unknown or damaged portion...
research
02/02/2021

Test-Time Adaptation for Out-of-distributed Image Inpainting

Deep learning-based image inpainting algorithms have shown great perform...
research
05/19/2023

A Unified Prompt-Guided In-Context Inpainting Framework for Reference-based Image Manipulations

Recent advancements in Text-to-Image (T2I) generative models have yielde...
research
06/26/2021

In-N-Out: Towards Good Initialization for Inpainting and Outpainting

In computer vision, recovering spatial information by filling in masked ...
research
02/18/2023

Modelos Generativos basados en Mecanismos de Difusión

Diffusion-based generative models are a design framework that allows gen...

Please sign up or login with your details

Forgot password? Click here to reset