Log In Sign Up

Hyperrealistic Image Inpainting with Hypergraphs

by   Gourav Wadhwa, et al.

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism to learn the global context of the image. This attention mechanism produces semantically plausible but blurry results because of incapability to capture the global context. In this paper, we introduce hypergraph convolution on spatial features to learn the complex relationship among the data. We introduce a trainable mechanism to connect nodes using hyperedges for hypergraph convolution. To the best of our knowledge, hypergraph convolution have never been used on spatial features for any image-to-image tasks in computer vision. Further, we introduce gated convolution in the discriminator to enforce local consistency in the predicted image. The experiments on Places2, CelebA-HQ, Paris Street View, and Facades datasets, show that our approach achieves state-of-the-art results.


page 1

page 4

page 6

page 7

page 8


Contextual Attention Mechanism, SRGAN Based Inpainting System for Eliminating Interruptions from Images

The new alternative is to use deep learning to inpaint any image by util...

Context-Aware Image Inpainting with Learned Semantic Priors

Recent advances in image inpainting have shown impressive results for ge...

Cross-View Image Synthesis with Deformable Convolution and Attention Mechanism

Learning to generate natural scenes has always been a daunting task in c...

Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions

A variety of attention mechanisms have been studied to improve the perfo...

In-N-Out: Towards Good Initialization for Inpainting and Outpainting

In computer vision, recovering spatial information by filling in masked ...

SAHDL: Sparse Attention Hypergraph Regularized Dictionary Learning

In recent years, the attention mechanism contributes significantly to hy...

PriorityCut: Occlusion-guided Regularization for Warp-based Image Animation

Image animation generates a video of a source image following the motion...