Fast and Reliable Architecture Selection for Convolutional Neural Networks

05/06/2019
by   Lukas Hahn, et al.
0

The performance of a Convolutional Neural Network (CNN) depends on its hyperparameters, like the number of layers, kernel sizes, or the learning rate for example. Especially in smaller networks and applications with limited computational resources, optimisation is key. We present a fast and efficient approach for CNN architecture selection. Taking into account time consumption, precision and robustness, we develop a heuristic to quickly and reliably assess a network's performance. In combination with Bayesian optimisation (BO), to effectively cover the vast parameter space, our contribution offers a plain and powerful architecture search for this machine learning technique.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2018

Neural Architecture Search with Bayesian Optimisation and Optimal Transport

Bayesian Optimisation (BO) refers to a class of methods for global optim...
research
09/04/2019

Rethinking the Number of Channels for the Convolutional Neural Network

Latest algorithms for automatic neural architecture search perform remar...
research
02/05/2019

DVOLVER: Efficient Pareto-Optimal Neural Network Architecture Search

Automatic search of neural network architectures is a standing research ...
research
07/16/2017

Efficient Architecture Search by Network Transformation

Techniques for automatically designing deep neural network architectures...
research
07/24/2021

Bayesian Optimisation for Premise Selection in Automated Theorem Proving (Student Abstract)

Modern theorem provers utilise a wide array of heuristics to control the...
research
12/17/2018

A Review of Meta-Reinforcement Learning for Deep Neural Networks Architecture Search

Deep Neural networks are efficient and flexible models that perform well...
research
10/18/2022

Optimisation Generalisation in Networks of Neurons

The goal of this thesis is to develop the optimisation and generalisatio...

Please sign up or login with your details

Forgot password? Click here to reset