Log In Sign Up

Weakly-Supervised Multi-Face 3D Reconstruction

by   Jialiang Zhang, et al.

3D face reconstruction plays a very important role in many real-world multimedia applications, including digital entertainment, social media, affection analysis, and person identification. The de-facto pipeline for estimating the parametric face model from an image requires to firstly detect the facial regions with landmarks, and then crop each face to feed the deep learning-based regressor. Comparing to the conventional methods performing forward inference for each detected instance independently, we suggest an effective end-to-end framework for multi-face 3D reconstruction, which is able to predict the model parameters of multiple instances simultaneously using single network inference. Our proposed approach not only greatly reduces the computational redundancy in feature extraction but also makes the deployment procedure much easier using the single network model. More importantly, we employ the same global camera model for the reconstructed faces in each image, which makes it possible to recover the relative head positions and orientations in the 3D scene. We have conducted extensive experiments to evaluate our proposed approach on the sparse and dense face alignment tasks. The experimental results indicate that our proposed approach is very promising on face alignment tasks without fully-supervision and pre-processing like detection and crop. Our implementation is publicly available at <>.


page 1

page 3

page 7

page 8

page 9


FoxNet: A Multi-face Alignment Method

Multi-face alignment aims to identify geometry structures of multiple hu...

Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment

3D face alignment of monocular images is a crucial process in the recogn...

End-to-end Weakly-supervised Multiple 3D Hand Mesh Reconstruction from Single Image

In this paper, we consider the challenging task of simultaneously locati...

Joint Face Detection and Facial Motion Retargeting for Multiple Faces

Facial motion retargeting is an important problem in both computer graph...

Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set

Recently, deep learning based 3D face reconstruction methods have shown ...

Self-supervised Learning of Detailed 3D Face Reconstruction

In this paper, we present an end-to-end learning framework for detailed ...

Realistic face animation generation from videos

3D face reconstruction and face alignment are two fundamental and highly...

Code Repositories