MOS: A Low Latency and Lightweight Framework for Face Detection, Landmark Localization, and Head Pose Estimation

10/21/2021
by   Yepeng Liu, et al.
9

With the emergence of service robots and surveillance cameras, dynamic face recognition (DFR) in wild has received much attention in recent years. Face detection and head pose estimation are two important steps for DFR. Very often, the pose is estimated after the face detection. However, such sequential computations lead to higher latency. In this paper, we propose a low latency and lightweight network for simultaneous face detection, landmark localization and head pose estimation. Inspired by the observation that it is more challenging to locate the facial landmarks for faces with large angles, a pose loss is proposed to constrain the learning. Moreover, we also propose an uncertainty multi-task loss to learn the weights of individual tasks automatically. Another challenge is that robots often use low computational units like ARM based computing core and we often need to use lightweight networks instead of the heavy ones, which lead to performance drop especially for small and hard faces. In this paper, we propose online feedback sampling to augment the training samples across different scales, which increases the diversity of training data automatically. Through validation in commonly used WIDER FACE, AFLW and AFLW2000 datasets, the results show that the proposed method achieves the state-of-the-art performance in low computational resources.

READ FULL TEXT

page 1

page 3

page 5

page 9

page 10

research
05/19/2020

MaskFace: multi-task face and landmark detector

Currently in the domain of facial analysis single task approaches for fa...
research
09/21/2023

A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose

Extreme head postures pose a common challenge across a spectrum of facia...
research
04/14/2020

Deep Entwined Learning Head Pose and Face Alignment Inside an Attentional Cascade with Doubly-Conditional fusion

Head pose estimation and face alignment constitute a backbone preprocess...
research
02/27/2021

Deep Active Shape Model for Face Alignment and Pose Estimation

Active Shape Model (ASM) is a statistical model of object shapes that re...
research
03/02/2017

Binarized Convolutional Landmark Localizers for Human Pose Estimation and Face Alignment with Limited Resources

Our goal is to design architectures that retain the groundbreaking perfo...
research
03/03/2016

HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

We present an algorithm for simultaneous face detection, landmarks local...
research
12/02/2019

Face Detection with Feature Pyramids and Landmarks

Accurate face detection and facial landmark localization are crucial to ...

Please sign up or login with your details

Forgot password? Click here to reset