DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Image

04/07/2022
by   Tetiana Martyniuk, et al.
0

We present DAD-3DHeads, a dense and diverse large-scale dataset, and a robust model for 3D Dense Head Alignment in the wild. It contains annotations of over 3.5K landmarks that accurately represent 3D head shape compared to the ground-truth scans. The data-driven model, DAD-3DNet, trained on our dataset, learns shape, expression, and pose parameters, and performs 3D reconstruction of a FLAME mesh. The model also incorporates a landmark prediction branch to take advantage of rich supervision and co-training of multiple related tasks. Experimentally, DAD-3DNet outperforms or is comparable to the state-of-the-art models in (i) 3D Head Pose Estimation on AFLW2000-3D and BIWI, (ii) 3D Face Shape Reconstruction on NoW and Feng, and (iii) 3D Dense Head Alignment and 3D Landmarks Estimation on DAD-3DHeads dataset. Finally, the diversity of DAD-3DHeads in camera angles, facial expressions, and occlusions enables a benchmark to study in-the-wild generalization and robustness to distribution shifts. The dataset webpage is https://p.farm/research/dad-3dheads.

READ FULL TEXT

page 1

page 13

page 15

page 16

page 18

page 20

page 21

page 22

research
05/16/2019

Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision

The estimation of 3D face shape from a single image must be robust to va...
research
04/12/2018

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling

We study 3D shape modeling from a single image and make contributions to...
research
08/29/2023

A lightweight 3D dense facial landmark estimation model from position map data

The incorporation of 3D data in facial analysis tasks has gained popular...
research
03/14/2018

Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wild

This paper investigates the evaluation of dense 3D face reconstruction f...
research
08/25/2022

Learning to regulate 3D head shape by removing occluding hair from in-the-wild images

Recent 3D face reconstruction methods reconstruct the entire head compar...
research
09/06/2021

Single-Camera 3D Head Fitting for Mixed Reality Clinical Applications

We address the problem of estimating the shape of a person's head, defin...
research
03/09/2019

Combining 3D Morphable Models: A Large scale Face-and-Head Model

Three-dimensional Morphable Models (3DMMs) are powerful statistical tool...

Please sign up or login with your details

Forgot password? Click here to reset