Cascaded Continuous Regression for Real-time Incremental Face Tracking

08/03/2016
by   Enrique Sánchez-Lozano, et al.
0

This paper introduces a novel real-time algorithm for facial landmark tracking. Compared to detection, tracking has both additional challenges and opportunities. Arguably the most important aspect in this domain is updating a tracker's models as tracking progresses, also known as incremental (face) tracking. While this should result in more accurate localisation, how to do this online and in real time without causing a tracker to drift is still an important open research question. We address this question in the cascaded regression framework, the state-of-the-art approach for facial landmark localisation. Because incremental learning for cascaded regression is costly, we propose a much more efficient yet equally accurate alternative using continuous regression. More specifically, we first propose cascaded continuous regression (CCR) and show its accuracy is equivalent to the Supervised Descent Method. We then derive the incremental learning updates for CCR (iCCR) and show that it is an order of magnitude faster than standard incremental learning for cascaded regression, bringing the time required for the update from seconds down to a fraction of a second, thus enabling real-time tracking. Finally, we evaluate iCCR and show the importance of incremental learning in achieving state-of-the-art performance. Code for our iCCR is available from http://www.cs.nott.ac.uk/ psxes1

READ FULL TEXT
research
12/07/2016

A Functional Regression approach to Facial Landmark Tracking

Linear regression is a fundamental building block in many face detection...
research
05/10/2019

A fast online cascaded regression algorithm for face alignment

Traditional face alignment based on machine learning usually tracks the ...
research
06/18/2020

Cascaded Regression Tracking: Towards Online Hard Distractor Discrimination

Visual tracking can be easily disturbed by similar surrounding objects. ...
research
09/02/2020

Real-time 3D Facial Tracking via Cascaded Compositional Learning

We propose to learn a cascade of globally-optimized modular boosted fern...
research
06/01/2020

Real-Time Face and Landmark Localization for Eyeblink Detection

Pavlovian eyeblink conditioning is a powerful experiment used in the fie...
research
11/21/2016

Cascaded Face Alignment via Intimacy Definition Feature

In this paper, we present a random-forest based fast cascaded regression...
research
02/13/2019

Joint Tracking of Multiple Quantiles Through Conditional Quantiles

Estimation of quantiles is one of the most fundamental real-time analysi...

Please sign up or login with your details

Forgot password? Click here to reset