Hyperrealistic Image Inpainting with Hypergraphs

11/05/2020
by   Gourav Wadhwa, et al.
0

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism to learn the global context of the image. This attention mechanism produces semantically plausible but blurry results because of incapability to capture the global context. In this paper, we introduce hypergraph convolution on spatial features to learn the complex relationship among the data. We introduce a trainable mechanism to connect nodes using hyperedges for hypergraph convolution. To the best of our knowledge, hypergraph convolution have never been used on spatial features for any image-to-image tasks in computer vision. Further, we introduce gated convolution in the discriminator to enforce local consistency in the predicted image. The experiments on Places2, CelebA-HQ, Paris Street View, and Facades datasets, show that our approach achieves state-of-the-art results.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
04/06/2022

Contextual Attention Mechanism, SRGAN Based Inpainting System for Eliminating Interruptions from Images

The new alternative is to use deep learning to inpaint any image by util...
research
06/14/2021

Context-Aware Image Inpainting with Learned Semantic Priors

Recent advances in image inpainting have shown impressive results for ge...
research
07/20/2020

Cross-View Image Synthesis with Deformable Convolution and Attention Mechanism

Learning to generate natural scenes has always been a daunting task in c...
research
04/21/2019

3G structure for image caption generation

It is a big challenge of computer vision to make machine automatically d...
research
06/26/2021

In-N-Out: Towards Good Initialization for Inpainting and Outpainting

In computer vision, recovering spatial information by filling in masked ...
research
10/23/2020

SAHDL: Sparse Attention Hypergraph Regularized Dictionary Learning

In recent years, the attention mechanism contributes significantly to hy...
research
07/08/2020

SiENet: Siamese Expansion Network for Image Extrapolation

Different from image inpainting, image outpainting has relative less con...

Please sign up or login with your details

Forgot password? Click here to reset