Log In Sign Up

A Unified Learning Approach for Hand Gesture Recognition and Fingertip Detection

by   Mohammad Mahmudul Alam, et al.

In human-computer interaction or sign language interpretation, recognizing hand gestures and detecting fingertips become ubiquitous in computer vision research. In this paper, a unified approach of convolutional neural network for both hand gesture recognition and fingertip detection is introduced. The proposed algorithm uses a single network to predict the probabilities of finger class and positions of fingertips in one forward propagation of the network. Instead of directly regressing the positions of fingertips from the fully connected layer, the ensemble of the position of fingertips is regressed from the fully convolutional network. Subsequently, the ensemble average is taken to regress the final position of fingertips. Since the whole pipeline uses a single network, it is significantly fast in computation. The proposed method results in remarkably less pixel error as compared to that in the direct regression approach and it outperforms the existing fingertip detection approaches including the Heatmap-based framework.


page 1

page 4

page 5

page 9

page 11

page 13

page 18

page 19


A Novel Hand Gesture Detection and Recognition system based on ensemble-based Convolutional Neural Network

Nowadays, hand gesture recognition has become an alternative for human-m...

3D dynamic hand gestures recognition using the Leap Motion sensor and convolutional neural networks

Defining methods for the automatic understanding of gestures is of param...

FineHand: Learning Hand Shapes for American Sign Language Recognition

American Sign Language recognition is a difficult gesture recognition pr...

A New GNG Graph-Based Hand Gesture Recognition Approach

Hand Gesture Recognition (HGR) is of major importance for Human-Computer...

Online interpretation of numeric sign language using 2-d skeletal model

Gesturing is one of the natural modes of human communication. Signs prod...

Anchors Based Method for Fingertips Position Estimation from a Monocular RGB Image using Deep Neural Network

In Virtual, augmented, and mixed reality, the use of hand gestures is in...

From Hand-Perspective Visual Information to Grasp Type Probabilities: Deep Learning via Ranking Labels

Limb deficiency severely affects the daily lives of amputees and drives ...

Code Repositories


Unified learning approach for egocentric hand gesture recognition and fingertip detection

view repo