DeepAI
Log In Sign Up

Hyperrealistic Image Inpainting with Hypergraphs

11/05/2020
by   Gourav Wadhwa, et al.
0

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism to learn the global context of the image. This attention mechanism produces semantically plausible but blurry results because of incapability to capture the global context. In this paper, we introduce hypergraph convolution on spatial features to learn the complex relationship among the data. We introduce a trainable mechanism to connect nodes using hyperedges for hypergraph convolution. To the best of our knowledge, hypergraph convolution have never been used on spatial features for any image-to-image tasks in computer vision. Further, we introduce gated convolution in the discriminator to enforce local consistency in the predicted image. The experiments on Places2, CelebA-HQ, Paris Street View, and Facades datasets, show that our approach achieves state-of-the-art results.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

04/06/2022

Contextual Attention Mechanism, SRGAN Based Inpainting System for Eliminating Interruptions from Images

The new alternative is to use deep learning to inpaint any image by util...
06/14/2021

Context-Aware Image Inpainting with Learned Semantic Priors

Recent advances in image inpainting have shown impressive results for ge...
07/20/2020

Cross-View Image Synthesis with Deformable Convolution and Attention Mechanism

Learning to generate natural scenes has always been a daunting task in c...
12/10/2021

Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions

A variety of attention mechanisms have been studied to improve the perfo...
06/26/2021

In-N-Out: Towards Good Initialization for Inpainting and Outpainting

In computer vision, recovering spatial information by filling in masked ...
10/23/2020

SAHDL: Sparse Attention Hypergraph Regularized Dictionary Learning

In recent years, the attention mechanism contributes significantly to hy...
03/22/2021

PriorityCut: Occlusion-guided Regularization for Warp-based Image Animation

Image animation generates a video of a source image following the motion...