DeepAI AI Chat
Log In Sign Up

Mobile Face Tracking: A Survey and Benchmark

by   Yiming Lin, et al.

With the rapid development of smartphones, facial analysis has been playing an increasingly important role in a multitude of mobile applications. In most scenarios, face tracking serves as a crucial first step because more often than not, a mobile application would only need to focus on analysing a specific face in a complex setting. Albeit inheriting many commons traits of the generic visual tracking problem, face tracking in mobile scenarios is characterised by a unique set of challenges. In this work, we propose iBUG MobiFace benchmark, the first mobile face tracking benchmark consisting of 50 sequences captured by smartphone users in unconstrained environments. The sequences contain a total of 50,736 frames with 46 distinct identities to be tracked. The tracking target in each sequence is selected with varying difficulties in mobile scenarios. In addition to frame by frame bounding box, the annotations of 9 sequence attributes(e.g. multiple faces) are provided. We further provide a survey of 23 state-of-the-art visual trackers and a comprehensive quantitative evaluation of these methods on the proposed benchmark. In particular, trackers from two most popular frameworks, namely, correlation filter-based tracking and deep learning-based tracking, are studied. Our experiment shows that (a) the performance of all existing generic object trackers drops significantly on the mobile face tracking scenario, suggesting the need of more research effort into mobile face tracking, and (b) the effective combination of deep learning tracking and face-related algorithms(e.g. face detection) provides the most promising basis for future developments in the field. The database, annotations and evaluation protocol/code will be made publicly available on the iBUG website.


LSOTB-TIR:A Large-Scale High-Diversity Thermal Infrared Object Tracking Benchmark

In this paper, we present a Large-Scale and high-diversity general Therm...

Densely tracking sequences of 3D face scans

3D face dense tracking aims to find dense inter-frame correspondences in...

Need for Speed: A Benchmark for Higher Frame Rate Object Tracking

In this paper, we propose the first higher frame rate video dataset (cal...

Event-based Dynamic Face Detection and Tracking Based on Activity

We present the first purely event-based approach for face detection usin...

TraX: The visual Tracking eXchange Protocol and Library

In this paper we address the problem of developing on-line visual tracki...

Predictive Visual Tracking: A New Benchmark and Baseline Approach

As a crucial robotic perception capability, visual tracking has been int...

Face Detection on Mobile: Five Implementations and Analysis

In many practical cases face detection on smartphones or other highly po...