3D Face Reconstruction with Region Based Best Fit Blending Using Mobile Phone for Virtual Reality Based Social Media

12/12/2017
by   Gholamreza Anbarjafari, et al.
0

The use of virtual reality (VR) is exponentially increasing and due to that many researchers has started to work on developing new VR based social media. For this purpose it is important to have an avatar of the users which look like them to be easily generated by the devices which are accessible, such as mobile phone. In this paper, we propose a novel method of recreating a 3D human face model captured with a phone camera image or video data. The method focuses more on model shape than texture in order to make the face recognizable. We detect 68 facial feature points and use them to separate a face into four regions. For each area the best fitting models are found and are further morphed combined to find the best fitting models for each area. These are then combined and further morphed in order to restore the original facial proportions. We also present a method of texturing the resulting model, where the aforementioned feature points are used to generate a texture for the resulting model

READ FULL TEXT

page 3

page 4

page 5

page 6

research
08/23/2022

"It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality

In social Virtual Reality (VR), users are embodied in avatars and intera...
research
07/22/2017

Eyemotion: Classifying facial expressions in VR using eye-tracking cameras

One of the main challenges of social interaction in virtual reality sett...
research
04/10/2021

Robust Egocentric Photo-realistic Facial Expression Transfer for Virtual Reality

Social presence, the feeling of being there with a real person, will fue...
research
07/04/2023

Generating Animatable 3D Cartoon Faces from Single Portraits

With the booming of virtual reality (VR) technology, there is a growing ...
research
08/11/2020

Audio- and Gaze-driven Facial Animation of Codec Avatars

Codec Avatars are a recent class of learned, photorealistic face models ...
research
01/27/2018

InteractiveGenerativeAdversarialNetworksforFacialExpressionGeneration in Dyadic Interactions

A social interaction is a social exchange between two or more individual...
research
08/31/2021

Realistic Hands: A Hybrid Model for 3D Hand Reconstruction

Estimating 3D hand meshes from RGB images robustly is a highly desirable...

Please sign up or login with your details

Forgot password? Click here to reset