Resource Efficient 3D Convolutional Neural Networks

04/04/2019
by   Okan Köpüklü, et al.
1

Recently, convolutional neural networks with 3D kernels (3D CNNs) have been very popular in computer vision community as a result of their superior ability of extracting spatio-temporal features within video frames compared to 2D CNNs. Although, there has been great advances recently to build resource efficient 2D CNN architectures considering memory and power budget, there is hardly any similar resource efficient architectures for 3D CNNs. In this paper, we have converted various well-known resource efficient 2D CNNs to 3D CNNs and evaluated their performance on three major benchmarks in terms of classification accuracy for different complexity levels. We have experimented on (1) Kinetics-600 dataset to inspect their capacity to learn, (2) Jester dataset to inspect their ability to capture hand motion patterns, and (3) UCF-101 to inspect the applicability of transfer learning. We have evaluated the run-time performance of each model on a single GPU and an embedded GPU. The results of this study show that these models can be utilized for different types of real-world applications since they provide real-time performance with considerable accuracies and memory usage. Our analysis on different complexity levels shows that the resource efficient 3D CNNs should not be designed too shallow or narrow in order to save complexity. The codes and pretrained models used in this work are publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2017

Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?

The purpose of this study is to determine whether current video datasets...
research
06/25/2022

UltraMNIST Classification: A Benchmark to Train CNNs for Very Large Images

Convolutional neural network (CNN) approaches available in the current l...
research
09/11/2019

Comparative Analysis of CNN-based Spatiotemporal Reasoning in Videos

Understanding actions and gestures in video streams requires temporal re...
research
09/27/2017

Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices

Convolutional Neural Networks (CNNs) have revolutionized the research in...
research
09/17/2022

A study on the deviations in performance of FNNs and CNNs in the realm of grayscale adversarial images

Neural Networks are prone to having lesser accuracy in the classificatio...
research
05/09/2019

1D Convolutional Neural Networks and Applications: A Survey

During the last decade, Convolutional Neural Networks (CNNs) have become...

Please sign up or login with your details

Forgot password? Click here to reset