SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

06/06/2021
by   Zeyu Ruan, et al.
0

Three-dimensional face dense alignment and reconstruction in the wild is a challenging problem as partial facial information is commonly missing in occluded and large pose face images. Large head pose variations also increase the solution space and make the modeling more difficult. Our key idea is to model occlusion and pose to decompose this challenging task into several relatively more manageable subtasks. To this end, we propose an end-to-end framework, termed as Self-aligned Dual face Regression Network (SADRNet), which predicts a pose-dependent face, a pose-independent face. They are combined by an occlusion-aware self-alignment to generate the final 3D face. Extensive experiments on two popular benchmarks, AFLW2000-3D and Florence, demonstrate that the proposed method achieves significant superior performance over existing state-of-the-art methods.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 10

page 12

page 13

research
04/11/2019

3D Dense Face Alignment via Graph Convolution Networks

Recently, 3D face reconstruction and face alignment tasks are gradually ...
research
05/19/2023

DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face Alignment

Sensitivity to severe occlusion and large view angles limits the usage s...
research
12/05/2018

Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment

Facial landmark localisation in images captured in-the-wild is an import...
research
10/25/2019

Real-time Memory Efficient Large-pose Face Alignment via Deep Evolutionary Network

There is an urgent need to apply face alignment in a memory-efficient an...
research
02/02/2016

Head Pose Estimation of Occluded Faces using Regularized Regression

This paper presents regression methods for estimation of head pose from ...
research
12/18/2022

Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GAN

Fine-grained semantic segmentation of a person's face and head, includin...
research
10/21/2019

Tree-gated Deep Mixture-of-Experts For Pose-robust Face Alignment

Face alignment consists of aligning a shape model on a face image. It is...

Please sign up or login with your details

Forgot password? Click here to reset