Constraining Dense Hand Surface Tracking with Elasticity

12/09/2020
by   ppeluse, et al.
0

Many of the actions that we take with our hands involve self-contact and occlusion: shaking hands, making a fist, or interlacing our fingers while thinking. This use of of our hands illustrates the importance of tracking hands through self-contact and occlusion for many applications in computer vision and graphics, but existing methods for tracking hands and faces are not designed to treat the extreme amounts of self-contact and self-occlusion exhibited by common hand gestures. By extending recent advances in vision-based tracking and physically based animation, we present the first algorithm capable of tracking high-fidelity hand deformations through highly self-contacting and self-occluding hand gestures, for both single hands and two hands. By constraining a vision-based tracking algorithm with a physically based deformable model, we obtain an algorithm that is robust to the ubiquitous self-interactions and massive self-occlusions exhibited by common hand gestures, allowing us to track two hand interactions and some of the most difficult possible configurations of a human hand.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 9

page 10

page 11

page 12

research
05/20/2021

Uma implementação do jogo Pedra, Papel e Tesoura utilizando Visao Computacional

This paper presents a game, controlled by computer vision, in identifica...
research
02/27/2020

In-Hand Object Pose Tracking via Contact Feedback and GPU-Accelerated Robotic Simulation

Tracking the pose of an object while it is being held and manipulated by...
research
12/30/2021

Feature Extraction and Prediction for Hand Hygiene Gestures with KNN Algorithm

This work focuses upon the analysis of hand gestures involved in the pro...
research
04/12/2022

3D Visual Tracking to Quantify Physical Contact Interactions in Human-to-Human Touch

Across a plethora of social situations, we touch others in natural and i...
research
11/01/2020

Tracking Partially-Occluded Deformable Objects while Enforcing Geometric Constraints

In order to manipulate a deformable object, such as rope or cloth, in un...
research
08/24/2023

FaceTouch: Detecting hand-to-face touch with supervised contrastive learning to assist in tracing infectious disease

Through our respiratory system, many viruses and diseases frequently spr...
research
05/16/2020

Towards in-store multi-person tracking using head detection and track heatmaps

Computer vision algorithms are being implemented across a breadth of ind...

Please sign up or login with your details

Forgot password? Click here to reset