Heavy Rain Face Image Restoration: Integrating Physical Degradation Model and Facial Component Guided Adversarial Learning

04/18/2022
by   Chang-Hwan Son, et al.
0

With the recent increase in intelligent CCTVs for visual surveillance, a new image degradation that integrates resolution conversion and synthetic rain models is required. For example, in heavy rain, face images captured by CCTV from a distance have significant deterioration in both visibility and resolution. Unlike traditional image degradation models (IDM), such as rain removal and superresolution, this study addresses a new IDM referred to as a scale-aware heavy rain model and proposes a method for restoring high-resolution face images (HR-FIs) from low-resolution heavy rain face images (LRHR-FI). To this end, a 2-stage network is presented. The first stage generates low-resolution face images (LR-FIs), from which heavy rain has been removed from the LRHR-FIs to improve visibility. To realize this, an interpretable IDM-based network is constructed to predict physical parameters, such as rain streaks, transmission maps, and atmospheric light. In addition, the image reconstruction loss is evaluated to enhance the estimates of the physical parameters. For the second stage, which aims to reconstruct the HR-FIs from the LR-FIs outputted in the first stage, facial component guided adversarial learning (FCGAL) is applied to boost facial structure expressions. To focus on informative facial features and reinforce the authenticity of facial components, such as the eyes and nose, a face-parsing-guided generator and facial local discriminators are designed for FCGAL. The experimental results verify that the proposed approach based on physical-based network design and FCGAL can remove heavy rain and increase the resolution and visibility simultaneously. Moreover, the proposed heavy-rain face image restoration outperforms state-of-the-art models of heavy rain removal, image-to-image translation, and superresolution.

READ FULL TEXT

page 1

page 3

page 5

page 9

page 10

page 12

page 27

page 28

research
02/29/2020

Joint Face Completion and Super-resolution using Multi-scale Feature Relation Learning

Previous research on face restoration often focused on repairing a speci...
research
04/10/2019

Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning

Most deraining works focus on rain streaks removal but they cannot deal ...
research
04/20/2020

Cosmetic-Aware Makeup Cleanser

Face verification aims at determining whether a pair of face images belo...
research
08/14/2020

Deep Atrous Guided Filter for Image Restoration in Under Display Cameras

Under Display Cameras present a promising opportunity for phone manufact...
research
10/15/2018

Refacing: reconstructing anonymized facial features using GANs

Anonymization of medical images is necessary for protecting the identity...
research
08/01/2017

Learning to Hallucinate Face Images via Component Generation and Enhancement

We propose a two-stage method for face hallucination. First, we generate...
research
07/18/2020

FaceHop: A Light-Weight Low-Resolution Face Gender Classification Method

A light-weight low-resolution face gender classification method, called ...

Please sign up or login with your details

Forgot password? Click here to reset