A Novel Hand Gesture Detection and Recognition system based on ensemble-based Convolutional Neural Network

02/25/2022
by   Abir Sen, et al.
13

Nowadays, hand gesture recognition has become an alternative for human-machine interaction. It has covered a large area of applications like 3D game technology, sign language interpreting, VR (virtual reality) environment, and robotics. But detection of the hand portion has become a challenging task in computer vision and pattern recognition communities. Deep learning algorithm like convolutional neural network (CNN) architecture has become a very popular choice for classification tasks, but CNN architectures suffer from some problems like high variance during prediction, overfitting problem and also prediction errors. To overcome these problems, an ensemble of CNN-based approaches is presented in this paper. Firstly, the gesture portion is detected by using the background separation method based on binary thresholding. After that, the contour portion is extracted, and the hand region is segmented. Then, the images have been resized and fed into three individual CNN models to train them in parallel. In the last part, the output scores of CNN models are averaged to construct an optimal ensemble model for the final prediction. Two publicly available datasets (labeled as Dataset-1 and Dataset-2) containing infrared images and one self-constructed dataset have been used to validate the proposed system. Experimental results are compared with the existing state-of-the-art approaches, and it is observed that our proposed ensemble model outperforms other existing proposed methods.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 10

page 14

research
01/06/2021

A Unified Learning Approach for Hand Gesture Recognition and Fingertip Detection

In human-computer interaction or sign language interpretation, recognizi...
research
09/20/2023

Hand Gesture Recognition with Two Stage Approach Using Transfer Learning and Deep Ensemble Learning

Human-Computer Interaction (HCI) has been the subject of research for ma...
research
06/14/2018

HGR-Net: A Two-stage Convolutional Neural Network for Hand Gesture Segmentation and Recognition

Robust recognition of hand gesture in real-world applications is still a...
research
07/07/2022

Design of Human Machine Interface through vision-based low-cost Hand Gesture Recognition system based on deep CNN

In this work, a real-time hand gesture recognition system-based human-co...
research
10/14/2021

CNN-DST: ensemble deep learning based on Dempster-Shafer theory for vibration-based fault recognition

Nowadays, using vibration data in conjunction with pattern recognition m...
research
12/08/2016

Joint Hand Detection and Rotation Estimation by Using CNN

Hand detection is essential for many hand related tasks, e.g. parsing ha...
research
08/14/2019

Recognition of Ischaemia and Infection in Diabetic Foot Ulcers: Dataset and Techniques

Diabetic Foot Ulcers (DFU) detection using computerized methods is an em...

Please sign up or login with your details

Forgot password? Click here to reset