Image Fine-grained Inpainting

02/07/2020
by   Zheng Hui, et al.
12

Image inpainting techniques have shown promising improvement with the assistance of generative adversarial networks (GANs) recently. However, most of them often suffered from completed results with unreasonable structure or blurriness. To mitigate this problem, in this paper, we present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields. Benefited from the property of this network, we can more easily recover large regions in an incomplete image. To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss for concentrating on uncertain areas and enhancing the semantic details. Besides, we devise a geometrical alignment constraint item to compensate for the pixel-based distance between prediction features and ground-truth ones. We also employ a discriminator with local and global branches to ensure local-global contents consistency. To further improve the quality of generated images, discriminator feature matching on the local branch is introduced, which dynamically minimizes the similarity of intermediate features between synthetic and ground-truth patches. Extensive experiments on several public datasets demonstrate that our approach outperforms current state-of-the-art methods. Code is available at <https://github.com/Zheng222/DMFN>.

READ FULL TEXT

page 3

page 4

page 7

page 8

research
12/21/2022

Exploring Content Relationships for Distilling Efficient GANs

This paper proposes a content relationship distillation (CRD) to tackle ...
research
12/04/2019

Diversity-Generated Image Inpainting with Style Extraction

The latest methods based on deep learning have achieved amazing results ...
research
02/28/2022

Local and Global GANs with Semantic-Aware Upsampling for Image Generation

In this paper, we address the task of semantic-guided image generation. ...
research
03/23/2023

Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learning

This paper presents a new adversarial training framework for image inpai...
research
09/23/2021

Towards Fine-grained 3D Face Dense Registration: An Optimal Dividing and Diffusing Method

Dense vertex-to-vertex correspondence between 3D faces is a fundamental ...
research
03/18/2023

Local-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Prediction

Predicting panoramic indoor lighting from a single perspective image is ...

Please sign up or login with your details

Forgot password? Click here to reset