ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

11/07/2020
by   Ilya Zakharkin, et al.
0

We present ZoomTouch - a breakthrough technology for multi-user control of robot from Zoom in real-time by DNN-based gesture recognition. The users from digital world can have a video conferencing and manipulate the robot to make the dexterous manipulations with tangible objects. As the scenario, we proposed the remote COVID-19 test Laboratory to considerably reduce the time to receive the data and substitute medical assistant working in protective gear in close proximity with infected cells. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.

READ FULL TEXT

page 1

page 2

research
10/20/2021

CobotAR: Interaction with Robots using Omnidirectionally Projected Image and DNN-based Gesture Recognition

Several technological solutions supported the creation of interfaces for...
research
09/25/2018

Human-Machine Interface for Remote Training of Robot Tasks

Regardless of their industrial or research application, the streamlining...
research
02/07/2021

DroneTrap: Drone Catching in Midair by Soft Robotic Hand with Color-Based Force Detection and Hand Gesture Recognition

The paper proposes a novel concept of docking drones to make this proces...
research
03/28/2023

Augmented Reality Remote Operation of Dual Arm Manipulators in Hot Boxes

In nuclear isotope and chemistry laboratories, hot cells and gloveboxes ...
research
12/25/2016

An Overview of Mobile Capacitive Touch Technologies Trends

Touch sensing, as a major human/machine interface, is widely used in var...
research
04/22/2023

SimplyMime: A Control at Our Fingertips

The utilization of consumer electronics, such as televisions, set-top bo...
research
03/07/2021

A Full Body Avatar-Based Telepresence System for Dissimilar Spaces

We present a novel mixed reality (MR) telepresence system enabling a loc...

Please sign up or login with your details

Forgot password? Click here to reset