Maintaining Performance with Less Data

08/03/2022
by   Dominic Sanderson, et al.
0

We propose a novel method for training a neural network for image classification to reduce input data dynamically, in order to reduce the costs of training a neural network model. As Deep Learning tasks become more popular, their computational complexity increases, leading to more intricate algorithms and models which have longer runtimes and require more input data. The result is a greater cost on time, hardware, and environmental resources. By using data reduction techniques, we reduce the amount of work performed, and therefore the environmental impact of AI techniques, and with dynamic data reduction we show that accuracy may be maintained while reducing runtime by up to 50 reducing carbon emission proportionally.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2019

Energy and Policy Considerations for Deep Learning in NLP

Recent progress in hardware and methodology for training neural networks...
research
07/12/2017

Autoencoder-augmented Neuroevolution for Visual Doom Playing

Neuroevolution has proven effective at many reinforcement learning tasks...
research
06/20/2021

Multirate Training of Neural Networks

We propose multirate training of neural networks: partitioning neural ne...
research
07/25/2019

Framelet Pooling Aided Deep Learning Network : The Method to Process High Dimensional Medical Data

Machine learning-based analysis of medical images often faces several hu...
research
10/21/2019

Quantifying the Carbon Emissions of Machine Learning

From an environmental standpoint, there are a few crucial aspects of tra...
research
02/27/2019

Reducing Artificial Neural Network Complexity: A Case Study on Exoplanet Detection

Despite their successes in the field of self-learning AI, Convolutional ...
research
05/07/2019

Variational training of neural network approximations of solution maps for physical models

A novel solve-training framework is proposed to train neural network in ...

Please sign up or login with your details

Forgot password? Click here to reset