DeepAI AI Chat
Log In Sign Up

Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes

by   Chenjie Cao, et al.
FUDAN University

This paper studies the task of inpainting man-made scenes. It is very challenging due to the difficulty in preserving the visual patterns of images, such as edges, lines, and junctions. Especially, most previous works are failed to restore the object/building structures for images of man-made scenes. To this end, this paper proposes learning a Sketch Tensor (ST) space for inpainting man-made scenes. Such a space is learned to restore the edges, lines, and junctions in images, and thus makes reliable predictions of the holistic image structures. To facilitate the structure refinement, we propose a Multi-scale Sketch Tensor inpainting (MST) network, with a novel encoder-decoder structure. The encoder extracts lines and edges from the input images to project them into an ST space. From this space, the decoder is learned to restore the input images. Extensive experiments validate the efficacy of our model. Furthermore, our model can also achieve competitive performance in inpainting general nature images over the competitors.


page 10

page 12

page 14

page 15

page 23

page 24

page 25

page 26


Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding

Image inpainting has made significant advances in recent years. However,...

Reference-Guided Texture and Structure Inference for Image Inpainting

Existing learning-based image inpainting methods are still in challenge ...

Semantic-Guided Inpainting Network for Complex Urban Scenes Manipulation

Manipulating images of complex scenes to reconstruct, insert and/or remo...

Towards Interactive Image Inpainting via Sketch Refinement

One tough problem of image inpainting is to restore complex structures i...

Automatic Semantic Content Removal by Learning to Neglect

We introduce a new system for automatic image content removal and inpain...

Extreme Face Inpainting with Sketch-Guided Conditional GAN

Recovering badly damaged face images is a useful yet challenging task, e...

Learning to Incorporate Structure Knowledge for Image Inpainting

This paper develops a multi-task learning framework that attempts to inc...

Code Repositories


Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes

view repo