Track Facial Points in Unconstrained Videos

09/09/2016
by   Xi Peng, et al.
0

Tracking Facial Points in unconstrained videos is challenging due to the non-rigid deformation that changes over time. In this paper, we propose to exploit incremental learning for person-specific alignment in wild conditions. Our approach takes advantage of part-based representation and cascade regression for robust and efficient alignment on each frame. Unlike existing methods that usually rely on models trained offline, we incrementally update the representation subspace and the cascade of regressors in a unified framework to achieve personalized modeling on the fly. To alleviate the drifting issue, the fitting results are evaluated using a deep neural network, where well-aligned faces are picked out to incrementally update the representation and fitting models. Both image and video datasets are employed to valid the proposed method. The results demonstrate the superior performance of our approach compared with existing approaches in terms of fitting accuracy and efficiency.

READ FULL TEXT

page 4

page 8

research
01/19/2017

3D Face Morphable Models "In-the-Wild"

3D Morphable Models (3DMMs) are powerful statistical models of 3D facial...
research
05/22/2016

3D Face Tracking and Texture Fusion in the Wild

We present a fully automatic approach to real-time 3D face reconstructio...
research
09/02/2020

Real-time 3D Facial Tracking via Cascaded Compositional Learning

We propose to learn a cascade of globally-optimized modular boosted fern...
research
05/10/2019

A fast online cascaded regression algorithm for face alignment

Traditional face alignment based on machine learning usually tracks the ...
research
07/18/2017

Faster Than Real-time Facial Alignment: A 3D Spatial Transformer Network Approach in Unconstrained Poses

Facial alignment involves finding a set of landmark points on an image w...
research
05/30/2021

Polygonal Point Set Tracking

In this paper, we propose a novel learning-based polygonal point set tra...
research
09/05/2022

Fast geometric trim fitting using partial incremental sorting and accumulation

We present an algorithmic contribution to improve the efficiency of robu...

Please sign up or login with your details

Forgot password? Click here to reset