An Analysis of Generative Methods for Multiple Image Inpainting

05/04/2022
by   Coloma Ballester, et al.
0

Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a unique solution. In this work, we focus on learning-based image completion methods for multiple and diverse inpainting which goal is to provide a set of distinct solutions for a given damaged image. These methods capitalize on the probabilistic nature of certain generative models to sample various solutions that coherently restore the missing content. Along the chapter, we will analyze the underlying theory and analyze the recent proposals for multiple inpainting. To investigate the pros and cons of each method, we present quantitative and qualitative comparisons, on common datasets, regarding both the quality and the diversity of the set of inpainted solutions. Our analysis allows us to identify the most successful generative strategies in both inpainting quality and inpainting diversity. This task is closely related to the learning of an accurate probability distribution of images. Depending on the dataset in use, the challenges that entail the training of such a model will be discussed through the analysis.

READ FULL TEXT

page 31

page 32

page 33

page 34

research
05/03/2022

Comparison of CoModGANs, LaMa and GLIDE for Art Inpainting- Completing M.C Escher's Print Gallery

Digital art restoration has benefited from inpainting models to correct ...
research
02/21/2020

Learning to Inpaint by Progressively Growing the Mask Regions

Image inpainting is one of the most challenging tasks in computer vision...
research
12/01/2018

Deep Inception Generative Network for Cognitive Image Inpainting

Recent advances in deep learning have shown exciting promise in filling ...
research
10/21/2019

ipA-MedGAN: Inpainting of Arbitrarily Regions in Medical Modalities

Local deformations in medical modalities are common phenomena due to a m...
research
09/29/2021

Generative Probabilistic Image Colorization

We propose Generative Probabilistic Image Colorization, a diffusion-base...
research
05/05/2021

PD-GAN: Probabilistic Diverse GAN for Image Inpainting

We propose PD-GAN, a probabilistic diverse GAN for image inpainting. Giv...
research
01/17/2018

Cahn--Hilliard inpainting with the double obstacle potential

The inpainting of damaged images has a wide range of applications and ma...

Please sign up or login with your details

Forgot password? Click here to reset