Restoration of the JPEG Maximum Lossy Compressed Face Images with Hourglass Block based on Early Stopping Discriminator

06/22/2023
by   Jongwook Si, et al.
0

When a JPEG image is compressed using the loss compression method with a high compression rate, a blocking phenomenon can occur in the image, making it necessary to restore the image to its original quality. In particular, restoring compressed images that are unrecognizable presents an innovative challenge. Therefore, this paper aims to address the restoration of JPEG images that have suffered significant loss due to maximum compression using a GAN-based net-work method. The generator in this network is based on the U-Net architecture and features a newly presented hourglass structure that can preserve the charac-teristics of deep layers. Additionally, the network incorporates two loss functions, LF Loss and HF Loss, to generate natural and high-performance images. HF Loss uses a pretrained VGG-16 network and is configured using a specific layer that best represents features, which can enhance performance for the high-frequency region. LF Loss, on the other hand, is used to handle the low-frequency region. These two loss functions facilitate the generation of images by the generator that can deceive the discriminator while accurately generating both high and low-frequency regions. The results show that the blocking phe-nomenon in lost compressed images was removed, and recognizable identities were generated. This study represents a significant improvement over previous research in terms of image restoration performance.

READ FULL TEXT

page 2

page 4

page 7

page 9

page 10

research
05/23/2018

Image Restoration by Estimating Frequency Distribution of Local Patches

In this paper, we propose a method to solve the image restoration proble...
research
06/01/2021

Fourier Space Losses for Efficient Perceptual Image Super-Resolution

Many super-resolution (SR) models are optimized for high performance onl...
research
05/07/2021

Toward Interactive Modulation for Photo-Realistic Image Restoration

Modulating image restoration level aims to generate a restored image by ...
research
10/09/2022

Invertible Rescaling Network and Its Extensions

Image rescaling is a commonly used bidirectional operation, which first ...
research
03/05/2023

Frequency-domain Blind Quality Assessment of Blurred and Blocking-artefact Images using Gaussian Process Regression model

Most of the standard image and video codecs are block-based and dependin...
research
04/18/2020

Moire Image Restoration using Multi Level Hyper Vision Net

A moire pattern in the images is resulting from high frequency patterns ...
research
03/20/2020

Learning the Loss Functions in a Discriminative Space for Video Restoration

With more advanced deep network architectures and learning schemes such ...

Please sign up or login with your details

Forgot password? Click here to reset