Detecting facial landmarks in the video based on a hybrid framework

09/21/2016
by   Nian Cai, et al.
0

To dynamically detect the facial landmarks in the video, we propose a novel hybrid framework termed as detection-tracking-detection (DTD). First, the face bounding box is achieved from the first frame of the video sequence based on a traditional face detection method. Then, a landmark detector detects the facial landmarks, which is based on a cascaded deep convolution neural network (DCNN). Next, the face bounding box in the current frame is estimated and validated after the facial landmarks in the previous frame are tracked based on the median flow. Finally, the facial landmarks in the current frame are exactly detected from the validated face bounding box via the landmark detector. Experimental results indicate that the proposed framework can detect the facial landmarks in the video sequence more effectively and with lower consuming time compared to the frame-by-frame method via the DCNN.

READ FULL TEXT

page 5

page 6

page 7

research
10/25/2021

Detecting speaking persons in video

We present a novel method for detecting speaking persons in video, by ex...
research
11/04/2020

Deep Learning Framework to Detect Face Masks from Video Footage

The use of facial masks in public spaces has become a social obligation ...
research
02/10/2015

Multi-view Face Detection Using Deep Convolutional Neural Networks

In this paper we consider the problem of multi-view face detection. Whil...
research
10/03/2020

Gaussian Vector: An Efficient Solution for Facial Landmark Detection

Significant progress has been made in facial landmark detection with the...
research
04/01/2020

Region Proposal Network with Graph Prior and IoU-Balance Loss for Landmark Detection in 3D Ultrasound

3D ultrasound (US) can facilitate detailed prenatal examinations for fet...
research
03/17/2020

KPNet: Towards Minimal Face Detector

The small receptive field and capacity of minimal neural networks limit ...
research
09/12/2022

Landmark Enhanced Multimodal Graph Learning for Deepfake Video Detection

With the rapid development of face forgery technology, deepfake videos h...

Please sign up or login with your details

Forgot password? Click here to reset