PropagationNet: Propagate Points to Curve to Learn Structure Information

06/25/2020
by   Xiehe Huang, et al.
0

Deep learning technique has dramatically boosted the performance of face alignment algorithms. However, due to large variability and lack of samples, the alignment problem in unconstrained situations, e.g large head poses, exaggerated expression, and uneven illumination, is still largely unsolved. In this paper, we explore the instincts and reasons behind our two proposals, i.e Propagation Module and Focal Wing Loss, to tackle the problem. Concretely, we present a novel structure-infused face alignment algorithm based on heatmap regression via propagating landmark heatmaps to boundary heatmaps, which provide structure information for further attention map generation. Moreover, we propose a Focal Wing Loss for mining and emphasizing the difficult samples under in-the-wild condition. In addition, we adopt methods like CoordConv and Anti-aliased CNN from other fields that address the shift-variance problem of CNN for face alignment. When implementing extensive experiments on different benchmarks, i.e WFLW, 300W, and COFW, our method outperforms state-of-the-arts by a significant margin. Our proposed approach achieves 4.05% mean error on WFLW, 2.93% mean error on 300W full-set, and 3.71% mean error on COFW.

READ FULL TEXT

page 2

page 3

page 4

page 7

research
05/26/2018

Look at Boundary: A Boundary-Aware Face Alignment Algorithm

We present a novel boundary-aware face alignment algorithm by utilising ...
research
04/16/2019

Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression

Heatmap regression has became one of the mainstream approaches to locali...
research
08/15/2016

Face Alignment In-the-Wild: A Survey

Over the last two decades, face alignment or localizing fiducial facial ...
research
03/22/2019

Joint 3D Face Reconstruction and Dense Face Alignment from A Single Image with 2D-Assisted Self-Supervised Learning

3D face reconstruction from a single 2D image is a challenging problem w...
research
07/18/2017

Faster Than Real-time Facial Alignment: A 3D Spatial Transformer Network Approach in Unconstrained Poses

Facial alignment involves finding a set of landmark points on an image w...
research
09/13/2021

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

The recent progress of CNN has dramatically improved face alignment perf...
research
03/12/2021

Seeking the Shape of Sound: An Adaptive Framework for Learning Voice-Face Association

Nowadays, we have witnessed the early progress on learning the associati...

Please sign up or login with your details

Forgot password? Click here to reset