DeepAI AI Chat
Log In Sign Up

ECOC as a Method of Constructing Deep Convolutional Neural Network Ensembles

by   Sara Atito Ali Ahmed, et al.

Deep neural networks have enhanced the performance of decision making systems in many applications including image understanding, and further gains can be achieved by constructing ensembles. However, designing an ensemble of deep networks is often not very beneficial since the time needed to train the constituent networks is very high or the performance gain obtained is not very significant. In this paper, we analyse error correcting output coding (ECOC) framework to be used as an ensemble technique for deep networks and propose different design strategies to address the accuracy-complexity trade-off. We carry out an extensive comparative study between the introduced ECOC designs and the state-of-the-art ensemble techniques such as ensemble averaging and gradient boosting decision trees. Furthermore, we propose a combinatory technique which is shown to reveal the highest classification performance amongst all.


page 1

page 2

page 3

page 4


Popular Ensemble Methods: An Empirical Study

An ensemble consists of a set of individually trained classifiers (such ...

Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks

Convolutional Neural Networks have achieved state-of-the-art performance...

Ensemble Methods of Classification for Power Systems Security Assessment

One of the most promising approaches for complex technical systems analy...

Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes

Neural network ensembles have been studied extensively in the context of...

Deep Architectures and Ensembles for Semantic Video Classification

This work addresses the problem of accurate semantic labelling of short ...

Neural Oblivious Decision Ensembles for Deep Learning on Tabular Data

Nowadays, deep neural networks (DNNs) have become the main instrument fo...

Prediction intervals for Deep Neural Networks

The aim of this paper is to propose a suitable method for constructing p...