DeepAI AI Chat
Log In Sign Up

SHREC 2021: Track on Skeleton-based Hand Gesture Recognition in the Wild

by   Ariel Caputo, et al.

Gesture recognition is a fundamental tool to enable novel interaction paradigms in a variety of application scenarios like Mixed Reality environments, touchless public kiosks, entertainment systems, and more. Recognition of hand gestures can be nowadays performed directly from the stream of hand skeletons estimated by software provided by low-cost trackers (Ultraleap) and MR headsets (Hololens, Oculus Quest) or by video processing software modules (e.g. Google Mediapipe). Despite the recent advancements in gesture and action recognition from skeletons, it is unclear how well the current state-of-the-art techniques can perform in a real-world scenario for the recognition of a wide set of heterogeneous gestures, as many benchmarks do not test online recognition and use limited dictionaries. This motivated the proposal of the SHREC 2021: Track on Skeleton-based Hand Gesture Recognition in the Wild. For this contest, we created a novel dataset with heterogeneous gestures featuring different types and duration. These gestures have to be found inside sequences in an online recognition scenario. This paper presents the result of the contest, showing the performances of the techniques proposed by four research groups on the challenging task compared with a simple baseline method.


page 2

page 10


Fast Gesture Recognition with Multiple Stream Discrete HMMs on 3D Skeletons

HMMs are widely used in action and gesture recognition due to their impl...

SHREC 2022 Track on Online Detection of Heterogeneous Gestures

This paper presents the outcomes of a contest organized to evaluate meth...

On-device Real-time Hand Gesture Recognition

We present an on-device real-time hand gesture recognition (HGR) system,...

Robust features for facial action recognition

Automatic recognition of facial gestures is becoming increasingly import...

HoloMed: A Low-Cost Gesture-Based Holographic

During medicine studies, visualization of certain elements is common and...

Hand Gesture Recognition Based on a Nonconvex Regularization

Recognition of hand gestures is one of the most fundamental tasks in hum...