PhoMoH: Implicit Photorealistic 3D Models of Human Heads

12/14/2022
by   Mihai Zanfir, et al.
0

We present PhoMoH, a neural network methodology to construct generative models of photorealistic 3D geometry and appearance of human heads including hair, beards, clothing and accessories. In contrast to prior work, PhoMoH models the human head using neural fields, thus supporting complex topology. Instead of learning a head model from scratch, we propose to augment an existing expressive head model with new features. Concretely, we learn a highly detailed geometry network layered on top of a mid-resolution head model together with a detailed, local geometry-aware, and disentangled color field. Our proposed architecture allows us to learn photorealistic human head models from relatively little data. The learned generative geometry and appearance networks can be sampled individually and allow the creation of diverse and realistic human heads. Extensive experiments validate our method qualitatively and across different metrics.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 9

page 10

page 11

research
11/28/2020

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

We present the first deep implicit 3D morphable model (i3DMM) of full he...
research
06/16/2022

Realistic One-shot Mesh-based Head Avatars

We present a system for realistic one-shot mesh-based human head avatars...
research
03/13/2022

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Talking head video generation aims to produce a synthetic human face vid...
research
04/19/2022

Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing

We present PHORHUM, a novel, end-to-end trainable, deep neural network m...
research
03/23/2023

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360^∘

Synthesis and reconstruction of 3D human head has gained increasing inte...
research
05/03/2023

AG3D: Learning to Generate 3D Avatars from 2D Image Collections

While progress in 2D generative models of human appearance has been rapi...
research
04/28/2023

Learning Locally Editable Virtual Humans

In this paper, we propose a novel hybrid representation and end-to-end t...

Please sign up or login with your details

Forgot password? Click here to reset