Multi-Scale Face Restoration with Sequential Gating Ensemble Network

by   Jianxin Lin, et al.

Restoring face images from distortions is important in face recognition applications and is challenged by multiple scale issues, which is still not well-solved in research area. In this paper, we present a Sequential Gating Ensemble Network (SGEN) for multi-scale face restoration issue. We first employ the principle of ensemble learning into SGEN architecture design to reinforce predictive performance of the network. The SGEN aggregates multi-level base-encoders and base-decoders into the network, which enables the network to contain multiple scales of receptive field. Instead of combining these base-en/decoders directly with non-sequential operations, the SGEN takes base-en/decoders from different levels as sequential data. Specifically, the SGEN learns to sequentially extract high level information from base-encoders in bottom-up manner and restore low level information from base-decoders in top-down manner. Besides, we propose to realize bottom-up and top-down information combination and selection with Sequential Gating Unit (SGU). The SGU sequentially takes two inputs from different levels and decides the output based on one active input. Experiment results demonstrate that our SGEN is more effective at multi-scale human face restoration with more image details and less noise than state-of-the-art image restoration models. By using adversarial training, SGEN also produces more visually preferred results than other models through subjective evaluation.


page 3

page 5

page 7


Sequential Gating Ensemble Network for Noise Robust Multi-Scale Face Restoration

Face restoration from low resolution and noise is important for applicat...

Progressive Semantic-Aware Style Transformation for Blind Face Restoration

Face restoration is important in face image processing, and has been wid...

Deep Semantic Face Deblurring

In this paper, we present an effective and efficient face deblurring alg...

Contrastive Attention Network with Dense Field Estimation for Face Completion

Most modern face completion approaches adopt an autoencoder or its varia...

Network Architecture Search for Face Enhancement

Various factors such as ambient lighting conditions, noise, motion blur,...

ForensicsForest Family: A Series of Multi-scale Hierarchical Cascade Forests for Detecting GAN-generated Faces

The prominent progress in generative models has significantly improved t...

Seeing through a Black Box: Toward High-Quality Terahertz TomographicImaging via Multi-Scale Spatio-Spectral Image Fusion

Terahertz tomographic imaging has recently arisen significant attention ...

Please sign up or login with your details

Forgot password? Click here to reset