Ensembles of Deep Neural Networks for Action Recognition in Still Images

03/22/2020
by   Sina Mohammadi, et al.
0

Despite the fact that notable improvements have been made recently in the field of feature extraction and classification, human action recognition is still challenging, especially in images, in which, unlike videos, there is no motion. Thus, the methods proposed for recognizing human actions in videos cannot be applied to still images. A big challenge in action recognition in still images is the lack of large enough datasets, which is problematic for training deep Convolutional Neural Networks (CNNs) due to the overfitting issue. In this paper, by taking advantage of pre-trained CNNs, we employ the transfer learning technique to tackle the lack of massive labeled action recognition datasets. Furthermore, since the last layer of the CNN has class-specific information, we apply an attention mechanism on the output feature maps of the CNN to extract more discriminative and powerful features for classification of human actions. Moreover, we use eight different pre-trained CNNs in our framework and investigate their performance on Stanford 40 dataset. Finally, we propose using the Ensemble Learning technique to enhance the overall accuracy of action classification by combining the predictions of multiple models. The best setting of our method is able to achieve 93.17% accuracy on the Stanford 40 dataset.

READ FULL TEXT
research
12/22/2015

Do Less and Achieve More: Training CNNs for Action Recognition Utilizing Action Images from the Web

Recently, attempts have been made to collect millions of videos to train...
research
02/07/2020

Learning Class Regularized Features for Action Recognition

Training Deep Convolutional Neural Networks (CNNs) is based on the notio...
research
12/23/2015

Convolutional Architecture Exploration for Action Recognition and Image Classification

Convolutional Architecture for Fast Feature Encoding (CAFFE) [11] is a s...
research
10/22/2022

Baby Physical Safety Monitoring in Smart Home Using Action Recognition System

Humans are able to intuitively deduce actions that took place between tw...
research
07/23/2022

Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning

In videos, the human's actions are of three-dimensional (3D) signals. Th...
research
04/21/2020

Combining Deep Learning Classifiers for 3D Action Recognition

The popular task of 3D human action recognition is almost exclusively so...

Please sign up or login with your details

Forgot password? Click here to reset