Deep Entwined Learning Head Pose and Face Alignment Inside an Attentional Cascade with Doubly-Conditional fusion

04/14/2020
by   Arnaud Dapogny, et al.
0

Head pose estimation and face alignment constitute a backbone preprocessing for many applications relying on face analysis. While both are closely related tasks, they are generally addressed separately, e.g. by deducing the head pose from the landmark locations. In this paper, we propose to entwine face alignment and head pose tasks inside an attentional cascade. This cascade uses a geometry transfer network for integrating heterogeneous annotations to enhance landmark localization accuracy. Furthermore, we propose a doubly-conditional fusion scheme to select relevant feature maps, and regions thereof, based on a current head pose and landmark localization estimate. We empirically show the benefit of entwining head pose and landmark localization objectives inside our architecture, and that the proposed AC-DC model enhances the state-of-the-art accuracy on multiple databases for both face alignment and head pose estimation tasks.

READ FULL TEXT

page 1

page 3

page 7

research
02/04/2022

Multi-task head pose estimation in-the-wild

We present a deep learning-based multi-task approach for head pose estim...
research
11/05/2016

Efficient Branching Cascaded Regression for Face Alignment under Significant Head Rotation

Despite much interest in face alignment in recent years, the large major...
research
09/30/2016

A CNN Cascade for Landmark Guided Semantic Part Segmentation

This paper proposes a CNN cascade for semantic part segmentation guided ...
research
08/28/2021

DeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis

Applications of deep learning to synthetic media generation allow the cr...
research
08/29/2019

3D Face Pose and Animation Tracking via Eigen-Decomposition based Bayesian Approach

This paper presents a new method to track both the face pose and the fac...
research
11/18/2019

Multiple Face Analyses through Adversarial Learning

This inherent relations among multiple face analysis tasks, such as land...
research
10/21/2021

MOS: A Low Latency and Lightweight Framework for Face Detection, Landmark Localization, and Head Pose Estimation

With the emergence of service robots and surveillance cameras, dynamic f...

Please sign up or login with your details

Forgot password? Click here to reset