DeepAI AI Chat
Log In Sign Up

Automatic Semantic Content Removal by Learning to Neglect

07/20/2018
by   Siyang Qin, et al.
2

We introduce a new system for automatic image content removal and inpainting. Unlike traditional inpainting algorithms, which require advance knowledge of the region to be filled in, our system automatically detects the area to be removed and infilled. Region segmentation and inpainting are performed jointly in a single pass. In this way, potential segmentation errors are more naturally alleviated by the inpainting module. The system is implemented as an encoder-decoder architecture, with two decoder branches, one tasked with segmentation of the foreground region, the other with inpainting. The encoder and the two decoder branches are linked via neglect nodes, which guide the inpainting process in selecting which areas need reconstruction. The whole model is trained using a conditional GAN strategy. Comparative experiments show that our algorithm outperforms state-of-the-art inpainting techniques (which, unlike our system, do not segment the input image and thus must be aided by an external segmentation module.)

READ FULL TEXT

page 4

page 6

page 8

page 9

08/13/2019

Boosted GAN with Semantically Interpretable Information for Image Inpainting

Image inpainting aims at restoring missing region of corrupted images, w...
09/13/2012

Hirarchical Digital Image Inpainting Using Wavelets

Inpainting is the technique of reconstructing unknown or damaged portion...
01/17/2019

Foreground-aware Image Inpainting

Existing image inpainting methods typically fill holes by borrowing info...
09/10/2019

Semantic Foreground Inpainting from Weak Supervision

Semantic scene understanding is an essential task for self-driving vehic...
03/11/2018

Cascade context encoder for improved inpainting

In this paper, we analyze if cascade usage of the context encoder with i...
03/28/2021

Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes

This paper studies the task of inpainting man-made scenes. It is very ch...
12/20/2021

DeePaste – Inpainting for Pasting

One of the challenges of supervised learning training is the need to pro...