Image inpainting using frequency domain priors

12/03/2020
by   Hiya Roy, et al.
0

In this paper, we present a novel image inpainting technique using frequency domain information. Prior works on image inpainting predict the missing pixels by training neural networks using only the spatial domain information. However, these methods still struggle to reconstruct high-frequency details for real complex scenes, leading to a discrepancy in color, boundary artifacts, distorted patterns, and blurry textures. To alleviate these problems, we investigate if it is possible to obtain better performance by training the networks using frequency domain information (Discrete Fourier Transform) along with the spatial domain information. To this end, we propose a frequency-based deconvolution module that enables the network to learn the global context while selectively reconstructing the high-frequency components. We evaluate our proposed method on the publicly available datasets CelebA, Paris Streetview, and DTD texture dataset, and show that our method outperforms current state-of-the-art image inpainting techniques both qualitatively and quantitatively.

READ FULL TEXT

page 3

page 5

page 10

page 11

page 13

research
08/05/2022

Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand

Deep image inpainting has made impressive progress with recent advances ...
research
08/19/2019

Adversarial Defense by Suppressing High-frequency Components

Recent works show that deep neural networks trained on image classificat...
research
05/19/2022

Towards Unified Keyframe Propagation Models

Many video editing tasks such as rotoscoping or object removal require t...
research
09/21/2022

Progressive with Purpose: Guiding Progressive Inpainting DNNs through Context and Structure

The advent of deep learning in the past decade has significantly helped ...
research
11/23/2021

Deep Residual Fourier Transformation for Single Image Deblurring

It has been a common practice to adopt the ResBlock, which learns the di...
research
05/29/2019

Learning Robust Global Representations by Penalizing Local Predictive Power

Despite their renowned predictive power on i.i.d. data, convolutional ne...
research
11/23/2017

Image Inpainting using Multi-Scale Feature Image Translation

We study the task of image inpainting, which is to fill in the missing r...

Please sign up or login with your details

Forgot password? Click here to reset