A Full Body Avatar-Based Telepresence System for Dissimilar Spaces

03/07/2021
by   Leonard Yoon, et al.
0

We present a novel mixed reality (MR) telepresence system enabling a local user to interact with a remote user through full-body avatars in their own rooms. If the remote rooms have different sizes and furniture arrangements, directly applying a user's motion to an avatar leads to a mismatch of placement and deictic gesture. To overcome this problem, we retarget the placement, arm gesture, and head movement of a local user to an avatar in a remote room to preserve a local user's environment and interaction context. This allows avatars to utilize real furniture and interact with a local user and shared objects as if they were in the same room. This paper describes our system's design and implementation in detail and a set of example scenarios in the living room and office room. A qualitative user study delves into a user experience, challenges, and possible extensions of the proposed system.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
06/20/2022

Visual Guidance for Remote Interaction in Avatar-Mediated Mixed-Reality Telepresence

Rapid advances in technology gradually realize immersive mixed-reality t...
research
12/22/2020

Placement Retargeting of Virtual Avatars to Dissimilar Indoor Environments

Rapidly developing technologies are realizing a 3D telepresence, in whic...
research
08/24/2022

Full Body Video-Based Self-Avatars for Mixed Reality: from E2E System to User Study

In this work we explore the creation of self-avatars through video pass-...
research
05/30/2023

A study on the Lombard Effect in telepresence robotics

In this study, we present a new experiment in order to study the Lombard...
research
01/23/2023

Understanding Context to Capture when Reconstructing Meaningful Spaces for Remote Instruction and Connecting in XR

Recent technological advances are enabling HCI researchers to explore in...
research
11/07/2020

ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

We present ZoomTouch - a breakthrough technology for multi-user control ...
research
11/10/2021

A Portable and Passive Gravity Compensation Arm Support for Drone Teleoperation

Gesture-based interfaces are often used to achieve a more natural and in...

Please sign up or login with your details

Forgot password? Click here to reset