3D Face Tracking and Texture Fusion in the Wild

05/22/2016
by   Patrik Huber, et al.
0

We present a fully automatic approach to real-time 3D face reconstruction from monocular in-the-wild videos. With the use of a cascaded-regressor based face tracking and a 3D Morphable Face Model shape fitting, we obtain a semi-dense 3D face shape. We further use the texture information from multiple frames to build a holistic 3D face representation from the video frames. Our system is able to capture facial expressions and does not require any person-specific training. We demonstrate the robustness of our approach on the challenging 300 Videos in the Wild (300-VW) dataset. Our real-time fitting framework is available as an open source library at http://4dface.org.

READ FULL TEXT

page 1

page 3

page 4

research
01/19/2017

3D Face Morphable Models "In-the-Wild"

3D Morphable Models (3DMMs) are powerful statistical models of 3D facial...
research
09/02/2020

Real-time 3D Facial Tracking via Cascaded Compositional Learning

We propose to learn a cascade of globally-optimized modular boosted fern...
research
10/07/2020

A Novel Face-tracking Mouth Controller and its Application to Interacting with Bioacoustic Models

We describe a simple, computationally light, real-time system for tracki...
research
03/28/2023

Real-time Multi-person Eyeblink Detection in the Wild for Untrimmed Video

Real-time eyeblink detection in the wild can widely serve for fatigue de...
research
06/03/2019

3D Magic Mirror: Automatic Video to 3D Caricature Translation

Caricature is an abstraction of a real person which distorts or exaggera...
research
09/09/2016

Track Facial Points in Unconstrained Videos

Tracking Facial Points in unconstrained videos is challenging due to the...
research
09/13/2017

Densely tracking sequences of 3D face scans

3D face dense tracking aims to find dense inter-frame correspondences in...

Please sign up or login with your details

Forgot password? Click here to reset