A Framework for Real-Time Face and Facial Feature Tracking using Optical Flow Pre-estimation and Template Tracking

by   E. R. Gast, et al.

This work presents a framework for tracking head movements and capturing the movements of the mouth and both the eyebrows in real-time. We present a head tracker which is a combination of a optical flow and a template based tracker. The estimation of the optical flow head tracker is used as starting point for the template tracker which fine-tunes the head estimation. This approach together with re-updating the optical flow points prevents the head tracker from drifting. This combination together with our switching scheme, makes our tracker very robust against fast movement and motion-blur. We also propose a way to reduce the influence of partial occlusion of the head. In both the optical flow and the template based tracker we identify and exclude occluded points.




Prediction Analysis of Optical Tracker Parameters using Machine Learning Approaches for efficient Head Tracking

A head tracker is a crucial part of the head mounted display systems, as...

SDOF-Tracker: Fast and Accurate Multiple Human Tracking by Skipped-Detection and Optical-Flow

Multiple human tracking is a fundamental problem for scene understanding...

Real-time Embedded Person Detection and Tracking for Shopping Behaviour Analysis

Shopping behaviour analysis through counting and tracking of people in s...

Head Gesture Recognition using Optical Flow based Classification with Reinforcement of GMM based Background Subtraction

This paper describes a technique of real time head gesture recognition s...

Hybrid Tracker with Pixel and Instance for Video Panoptic Segmentation

Video Panoptic Segmentation (VPS) requires generating consistent panopti...

Low-cost Autonomous Navigation System Based on Optical Flow Classification

This work presents a low-cost robot, controlled by a Raspberry Pi, whose...

Robust Performance-driven 3D Face Tracking in Long Range Depth Scenes

We introduce a novel robust hybrid 3D face tracking framework from RGBD ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.