Rethinking Recurrent Neural Networks and other Improvements for Image Classification

07/30/2020
by   Nguyen Huu Phong, et al.
0

For a long history of Machine Learning which dates back to several decades, Recurrent Neural Networks (RNNs) have been mainly used for sequential data and time series or generally 1D information. Even in some rare researches on 2D images, the networks merely learn and generate data sequentially rather than for recognition of images. In this research, we propose to integrate RNN as an additional layer in designing image recognition's models. Moreover, we develop End-to-End Ensemble Multi-models that are able to learn experts' predictions from several models. Besides, we extend training strategy and softmax pruning which overall leads our designs to perform comparably to top models on several datasets. The source code of the methods provided in this article is available in https://github.com/leonlha/e2e-3m and http://nguyenhuuphong.me.

READ FULL TEXT

page 3

page 6

page 8

page 9

page 10

page 11

page 14

page 15

research
08/22/2017

Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

Recurrent Neural Networks (RNNs) continue to show outstanding performanc...
research
04/12/2021

Traffic Forecasting using Vehicle-to-Vehicle Communication

We take the first step in using vehicle-to-vehicle (V2V) communication t...
research
09/13/2015

Learning Contextual Dependencies with Convolutional Hierarchical Recurrent Neural Networks

Existing deep convolutional neural networks (CNNs) have shown their grea...
research
04/11/2021

GR-RNN: Global-Context Residual Recurrent Neural Networks for Writer Identification

This paper presents an end-to-end neural network system to identify writ...
research
03/21/2018

Comparing Fixed and Adaptive Computation Time for Recurrent Neural Networks

Adaptive Computation Time for Recurrent Neural Networks (ACT) is one of ...
research
03/30/2022

A Fast Transformer-based General-Purpose Lossless Compressor

Deep-learning-based compressor has received interests recently due to mu...
research
03/30/2017

Dynamic Computational Time for Visual Attention

We propose a dynamic computational time model to accelerate the average ...

Please sign up or login with your details

Forgot password? Click here to reset