Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes

03/15/2020
by   Liang Liao, et al.
0

Completing a corrupted image with correct structures and reasonable textures for a mixed scene remains an elusive challenge. Since the missing hole in a mixed scene of a corrupted image often contains various semantic information, conventional two-stage approaches utilizing structural information often lead to the problem of unreliable structural prediction and ambiguous image texture generation. In this paper, we propose a Semantic Guidance and Evaluation Network (SGE-Net) to iteratively update the structural priors and the inpainted image in an interplay framework of semantics extraction and image inpainting. It utilizes semantic segmentation map as guidance in each scale of inpainting, under which location-dependent inferences are re-evaluated, and, accordingly, poorly-inferred regions are refined in subsequent scales. Extensive experiments on real-world images of mixed scenes demonstrated the superiority of our proposed method over state-of-the-art approaches, in terms of clear boundaries and photo-realistic textures.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 10

page 13

page 14

page 15

research
12/15/2020

Image Inpainting Guided by Coherence Priors of Semantics and Textures

Existing inpainting methods have achieved promising performance in recov...
research
10/19/2020

Semantic-Guided Inpainting Network for Complex Urban Scenes Manipulation

Manipulating images of complex scenes to reconstruct, insert and/or remo...
research
06/14/2021

Context-Aware Image Inpainting with Learned Semantic Priors

Recent advances in image inpainting have shown impressive results for ge...
research
01/26/2022

Interactive Image Inpainting Using Semantic Guidance

Image inpainting approaches have achieved significant progress with the ...
research
10/12/2022

ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors

The image inpainting task fills missing areas of a corrupted image. Desp...
research
12/08/2021

Fully Context-Aware Image Inpainting with a Learned Semantic Pyramid

Restoring reasonable and realistic content for arbitrary missing regions...
research
08/31/2023

Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Details

We propose Text2Scene, a method to automatically create realistic textur...

Please sign up or login with your details

Forgot password? Click here to reset