DeepAI AI Chat
Log In Sign Up

Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs

07/15/2019
by   Yury Kartynnik, et al.
Google
0

We present an end-to-end neural network-based model for inferring an approximate 3D mesh representation of a human face from single camera input for AR applications. The relatively dense mesh model of 468 vertices is well-suited for face-based AR effects. The proposed model demonstrates super-realtime inference speed on mobile GPUs (100-1000+ FPS, depending on the device and model variant) and a high prediction quality that is comparable to the variance in manual annotations of the same image.

READ FULL TEXT

page 1

page 2

page 3

07/15/2019

Real-time Hair Segmentation and Recoloring on Mobile GPUs

We present a novel approach for neural network-based hair segmentation f...
06/19/2020

Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

We present Attention Mesh, a lightweight architecture for 3D face mesh p...
06/18/2020

MediaPipe Hands: On-device Real-time Hand Tracking

We present a real-time on-device hand tracking pipeline that predicts ha...
07/11/2019

BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUs

We present BlazeFace, a lightweight and well-performing face detector ta...
03/17/2023

MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video

We present a new approach for learning Mobile Realistic Fullbody (MoRF) ...
10/05/2018

ReTiCaM: Real-time Human Performance Capture from Monocular Video

We present the first real-time human performance capture approach that r...