Less is More: Accelerating Faster Neural Networks Straight from JPEG

04/01/2021
by   Samuel Felipe dos Santos, et al.
0

Most image data available are often stored in a compressed format, from which JPEG is the most widespread. To feed this data on a convolutional neural network (CNN), a preliminary decoding process is required to obtain RGB pixels, demanding a high computational load and memory usage. For this reason, the design of CNNs for processing JPEG compressed data has gained attention in recent years. In most existing works, typical CNN architectures are adapted to facilitate the learning with the DCT coefficients rather than RGB pixels. Although they are effective, their architectural changes either raise the computational costs or neglect relevant information from DCT inputs. In this paper, we examine different ways of speeding up CNNs designed for DCT inputs, exploiting learning strategies to reduce the computational complexity by taking full advantage of DCT inputs. Our experiments were conducted on the ImageNet dataset. Results show that learning how to combine all DCT inputs in a data-driven fashion is better than discarding them by hand, and its combination with a reduction of layers has proven to be effective for reducing the computational costs while retaining accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/20/2023

CNNs for JPEGs: A Study in Computational Cost

Convolutional neural networks (CNNs) have achieved astonishing advances ...
research
12/26/2020

Deep Learning Towards Edge Computing: Neural Networks Straight from Compressed Data

Due to the popularization and grow in computational power of mobile phon...
research
12/26/2020

Faster and Accurate Compressed Video Action Recognition Straight from the Frequency Domain

Human action recognition has become one of the most active field of rese...
research
07/26/2019

DCT-CompCNN: A Novel Image Classification Network Using JPEG Compressed DCT Coefficients

The popularity of Convolutional Neural Network (CNN) in the field of Ima...
research
02/27/2019

Reducing Artificial Neural Network Complexity: A Case Study on Exoplanet Detection

Despite their successes in the field of self-learning AI, Convolutional ...
research
07/25/2023

A signal processing interpretation of noise-reduction convolutional neural networks

Encoding-decoding CNNs play a central role in data-driven noise reductio...
research
03/14/2022

There's no difference: Convolutional Neural Networks for transient detection without template subtraction

We present a Convolutional Neural Network (CNN) model for the separation...

Please sign up or login with your details

Forgot password? Click here to reset