Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar

by   Peike Li, et al.

Conventional face super-resolution methods usually assume testing low-resolution (LR) images lie in the same domain as the training ones. Due to different lighting conditions and imaging hardware, domain gaps between training and testing images inevitably occur in many real-world scenarios. Neglecting those domain gaps would lead to inferior face super-resolution (FSR) performance. However, how to transfer a trained FSR model to a target domain efficiently and effectively has not been investigated. To tackle this problem, we develop a Domain-Aware Pyramid-based Face Super-Resolution network, named DAP-FSR network. Our DAP-FSR is the first attempt to super-resolve LR faces from a target domain by exploiting only a pair of high-resolution (HR) and LR exemplar in the target domain. To be specific, our DAP-FSR firstly employs its encoder to extract the multi-scale latent representations of the input LR face. Considering only one target domain example is available, we propose to augment the target domain data by mixing the latent representations of the target domain face and source domain ones, and then feed the mixed representations to the decoder of our DAP-FSR. The decoder will generate new face images resembling the target domain image style. The generated HR faces in turn are used to optimize our decoder to reduce the domain gap. By iteratively updating the latent representations and our decoder, our DAP-FSR will be adapted to the target domain, thus achieving authentic and high-quality upsampled HR faces. Extensive experiments on three newly constructed benchmarks validate the effectiveness and superior performance of our DAP-FSR compared to the state-of-the-art.


page 5

page 7

page 8


AIM 2019 Challenge on Real-World Image Super-Resolution: Methods and Results

This paper reviews the AIM 2019 challenge on real world super-resolution...

One-Shot Domain Adaptation For Face Generation

In this paper, we propose a framework capable of generating face images ...

Unsupervised Real-world Image Super Resolution via Domain-distance Aware Training

These days, unsupervised super-resolution (SR) has been soaring due to i...

Semantic Encoder Guided Generative Adversarial Face Ultra-Resolution Network

Face super-resolution is a domain-specific image super-resolution, which...

A Unified Framework to Super-Resolve Face Images of Varied Low Resolutions

The existing face image super-resolution (FSR) algorithms usually train ...

Cross-Domain Style Mixing for Face Cartoonization

Cartoon domain has recently gained increasing popularity. Previous studi...

MODIFY: Model-driven Face Stylization without Style Images

Existing face stylization methods always acquire the presence of the tar...

Please sign up or login with your details

Forgot password? Click here to reset