Sub-pixel face landmarks using heatmaps and a bag of tricks

03/04/2021
by   Samuel W. F. Earp, et al.
0

Accurate face landmark localization is an essential part of face recognition, reconstruction and morphing. To accurately localize face landmarks, we present our heatmap regression approach. Each model consists of a MobileNetV2 backbone followed by several upscaling layers, with different tricks to optimize both performance and inference cost. We use five naïve face landmarks from a publicly available face detector to position and align the face instead of using the bounding box like traditional methods. Moreover, we show by adding random rotation, displacement and scaling – after alignment – that the model is more sensitive to the face position than orientation. We also show that it is possible to reduce the upscaling complexity by using a mixture of deconvolution and pixel-shuffle layers without impeding localization performance. We present our state-of-the-art face landmark localization model (ranking second on The 2nd Grand Challenge of 106-Point Facial Landmark Localization validation set). Finally, we test the effect on face recognition using these landmarks, using a publicly available model and benchmarks.

READ FULL TEXT
research
05/09/2019

Grand Challenge of 106-Point Facial Landmark Localization

Facial landmark localization is a very crucial step in numerous face rel...
research
04/22/2019

FoxNet: A Multi-face Alignment Method

Multi-face alignment aims to identify geometry structures of multiple hu...
research
12/02/2019

Face Detection with Feature Pyramids and Landmarks

Accurate face detection and facial landmark localization are crucial to ...
research
04/07/2021

HIH: Towards More Accurate Face Alignment via Heatmap in Heatmap

Recently, heatmap regression models have become the mainstream in locati...
research
02/10/2021

Searching for Alignment in Face Recognition

A standard pipeline of current face recognition frameworks consists of f...
research
11/30/2022

Part-based Face Recognition with Vision Transformers

Holistic methods using CNNs and margin-based losses have dominated resea...
research
01/29/2016

Face Alignment by Local Deep Descriptor Regression

We present an algorithm for extracting key-point descriptors using deep ...

Please sign up or login with your details

Forgot password? Click here to reset