DeepAI AI Chat
Log In Sign Up

Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes

03/28/2021
by   Chenjie Cao, et al.
FUDAN University
13

This paper studies the task of inpainting man-made scenes. It is very challenging due to the difficulty in preserving the visual patterns of images, such as edges, lines, and junctions. Especially, most previous works are failed to restore the object/building structures for images of man-made scenes. To this end, this paper proposes learning a Sketch Tensor (ST) space for inpainting man-made scenes. Such a space is learned to restore the edges, lines, and junctions in images, and thus makes reliable predictions of the holistic image structures. To facilitate the structure refinement, we propose a Multi-scale Sketch Tensor inpainting (MST) network, with a novel encoder-decoder structure. The encoder extracts lines and edges from the input images to project them into an ST space. From this space, the decoder is learned to restore the input images. Extensive experiments validate the efficacy of our model. Furthermore, our model can also achieve competitive performance in inpainting general nature images over the competitors.

READ FULL TEXT

page 10

page 12

page 14

page 15

page 23

page 24

page 25

page 26

03/02/2022

Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding

Image inpainting has made significant advances in recent years. However,...
07/29/2022

Reference-Guided Texture and Structure Inference for Image Inpainting

Existing learning-based image inpainting methods are still in challenge ...
10/19/2020

Semantic-Guided Inpainting Network for Complex Urban Scenes Manipulation

Manipulating images of complex scenes to reconstruct, insert and/or remo...
06/01/2023

Towards Interactive Image Inpainting via Sketch Refinement

One tough problem of image inpainting is to restore complex structures i...
07/20/2018

Automatic Semantic Content Removal by Learning to Neglect

We introduce a new system for automatic image content removal and inpain...
05/13/2021

Extreme Face Inpainting with Sketch-Guided Conditional GAN

Recovering badly damaged face images is a useful yet challenging task, e...
02/11/2020

Learning to Incorporate Structure Knowledge for Image Inpainting

This paper develops a multi-task learning framework that attempts to inc...

Code Repositories

MST_inpainting

Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes


view repo