A Functional Regression approach to Facial Landmark Tracking

12/07/2016
by   Enrique Sánchez-Lozano, et al.
0

Linear regression is a fundamental building block in many face detection and tracking algorithms, typically used to predict shape displacements from image features through a linear mapping. This paper presents a Functional Regression solution to the least squares problem, which we coin Continuous Regression, resulting in the first real-time incremental face tracker. Contrary to prior work in Functional Regression, in which B-splines or Fourier series were used, we propose to approximate the input space by its first-order Taylor expansion, yielding a closed-form solution for the continuous domain of displacements. We then extend the continuous least squares problem to correlated variables, and demonstrate the generalisation of our approach. We incorporate Continuous Regression into the cascaded regression framework, and show its computational benefits for both training and testing. We then present a fast approach for incremental learning within Cascaded Continuous Regression, coined iCCR, and show that its complexity allows real-time face tracking, being 20 times faster than the state of the art. To the best of our knowledge, this is the first incremental face tracker that is shown to operate in real-time. We show that iCCR achieves state-of-the-art performance on the 300-VW dataset, the most recent, large-scale benchmark for face tracking.

READ FULL TEXT

page 13

page 14

research
08/03/2016

Cascaded Continuous Regression for Real-time Incremental Face Tracking

This paper introduces a novel real-time algorithm for facial landmark tr...
research
05/10/2019

A fast online cascaded regression algorithm for face alignment

Traditional face alignment based on machine learning usually tracks the ...
research
07/14/2018

Real-Time Shape Tracking of Facial Landmarks

Detection of facial landmarks and accurate tracking of their shape are e...
research
06/18/2020

Cascaded Regression Tracking: Towards Online Hard Distractor Discrimination

Visual tracking can be easily disturbed by similar surrounding objects. ...
research
06/01/2020

Real-Time Face and Landmark Localization for Eyeblink Detection

Pavlovian eyeblink conditioning is a powerful experiment used in the fie...
research
09/02/2020

Real-time 3D Facial Tracking via Cascaded Compositional Learning

We propose to learn a cascade of globally-optimized modular boosted fern...
research
12/08/2021

COSMIC: fast closed-form identification from large-scale data for LTV systems

We introduce a closed-form method for identification of discrete-time li...

Please sign up or login with your details

Forgot password? Click here to reset