Facial De-occlusion Network for Virtual Telepresence Systems

10/23/2022
by   Surabhi Gupta, et al.
0

To see what is not in the image is one of the broader missions of computer vision. Technology to inpaint images has made significant progress with the coming of deep learning. This paper proposes a method to tackle occlusion specific to human faces. Virtual presence is a promising direction in communication and recreation for the future. However, Virtual Reality (VR) headsets occlude a significant portion of the face, hindering the photo-realistic appearance of the face in the virtual world. State-of-the-art image inpainting methods for de-occluding the eye region does not give usable results. To this end, we propose a working solution that gives usable results to tackle this problem enabling the use of the real-time photo-realistic de-occluded face of the user in VR settings.

READ FULL TEXT

page 1

page 3

page 4

research
10/11/2016

FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality

We introduce FaceVR, a novel method for gaze-aware facial reenactment in...
research
07/22/2017

Eyemotion: Classifying facial expressions in VR using eye-tracking cameras

One of the main challenges of social interaction in virtual reality sett...
research
01/04/2023

Towards a Pipeline for Real-Time Visualization of Faces for VR-based Telepresence and Live Broadcasting Utilizing Neural Rendering

While head-mounted displays (HMDs) for Virtual Reality (VR) have become ...
research
10/12/2020

Omni-Directional Image Generation from Single Snapshot Image

An omni-directional image (ODI) is the image that has a field of view co...
research
07/04/2023

Generating Animatable 3D Cartoon Faces from Single Portraits

With the booming of virtual reality (VR) technology, there is a growing ...
research
12/02/2021

Attention based Occlusion Removal for Hybrid Telepresence Systems

Traditionally, video conferencing is a widely adopted solution for telec...
research
03/29/2021

High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation

3D video avatars can empower virtual communications by providing compres...

Please sign up or login with your details

Forgot password? Click here to reset