Feature Super-Resolution Based Facial Expression Recognition for Multi-scale Low-Resolution Faces

by   Wei Jing, et al.

Facial Expressions Recognition(FER) on low-resolution images is necessary for applications like group expression recognition in crowd scenarios(station, classroom etc.). Classifying a small size facial image into the right expression category is still a challenging task. The main cause of this problem is the loss of discriminative feature due to reduced resolution. Super-resolution method is often used to enhance low-resolution images, but the performance on FER task is limited when on images of very low resolution. In this work, inspired by feature super-resolution methods for object detection, we proposed a novel generative adversary network-based feature level super-resolution method for robust facial expression recognition(FSR-FER). In particular, a pre-trained FER model was employed as feature extractor, and a generator network G and a discriminator network D are trained with features extracted from images of low resolution and original high resolution. Generator network G tries to transform features of low-resolution images to more discriminative ones by making them closer to the ones of corresponding high-resolution images. For better classification performance, we also proposed an effective classification-aware loss re-weighting strategy based on the classification probability calculated by a fixed FER model to make our model focus more on samples that are easily misclassified. Experiment results on Real-World Affective Faces (RAF) Database demonstrate that our method achieves satisfying results on various down-sample factors with a single model and has better performance on low-resolution images compared with methods using image super-resolution and expression recognition separately.


page 2

page 8


Verification of Very Low-Resolution Faces Using An Identity-Preserving Deep Face Super-Resolution Network

Face super-resolution methods usually aim at producing visually appealin...

Super-resolution Guided Pore Detection for Fingerprint Recognition

Performance of fingerprint recognition algorithms substantially rely on ...

Feature Intertwiner for Object Detection

A well-trained model should classify objects with a unanimous score for ...

SRMAE: Masked Image Modeling for Scale-Invariant Deep Representations

Due to the prevalence of scale variance in nature images, we propose to ...

Animating Through Warping: an Efficient Method for High-Quality Facial Expression Animation

Advances in deep neural networks have considerably improved the art of a...

Small Noisy and Perspective Face Detection using Deformable Symmetric Gabor Wavelet Network

Face detection and tracking in low resolution image is not a trivial tas...

Robust Degraded Face Recognition Using Enhanced Local Frequency Descriptor and Multi-scale Competition

Recognizing degraded faces from low resolution and blurred images are co...

Please sign up or login with your details

Forgot password? Click here to reset