Realistic One-shot Mesh-based Head Avatars

06/16/2022
by   Taras Khakhulin, et al.
0

We present a system for realistic one-shot mesh-based human head avatars creation, ROME for short. Using a single photograph, our model estimates a person-specific head mesh and the associated neural texture, which encodes both local photometric and geometric details. The resulting avatars are rigged and can be rendered using a neural network, which is trained alongside the mesh and texture estimators on a dataset of in-the-wild videos. In the experiments, we observe that our system performs competitively both in terms of head geometry recovery and the quality of renders, especially for the cross-person reenactment. See results https://samsunglabs.github.io/rome/

READ FULL TEXT

page 2

page 9

page 11

page 24

page 25

page 26

page 27

page 29

research
05/20/2019

Few-Shot Adversarial Learning of Realistic Neural Talking Head Models

Several recent works have shown how highly realistic human head images c...
research
08/24/2020

Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars

We propose a neural rendering-based system that creates head avatars fro...
research
12/14/2022

PhoMoH: Implicit Photorealistic 3D Models of Human Heads

We present PhoMoH, a neural network methodology to construct generative ...
research
08/27/2020

CenterHMR: a Bottom-up Single-shot Method for Multi-person 3D Mesh Recovery from a Single Image

In this paper, we propose a method to recover multi-person 3D mesh from ...
research
12/02/2021

Neural Head Avatars from Monocular RGB Videos

We present Neural Head Avatars, a novel neural representation that expli...
research
03/18/2022

Highly Adaptive and Automated Tetrahedral Mesh Generator for Multi-Compartment Human Head Model with Deep Brain Structures in EEG

This paper introduces a highly adaptive and automated approach for gener...
research
12/17/2020

Human Mesh Recovery from Multiple Shots

Videos from edited media like movies are a useful, yet under-explored so...

Please sign up or login with your details

Forgot password? Click here to reset