Incremental Deep Neural Network Learning using Classification Confidence Thresholding

by   Justin Leo, et al.

Most modern neural networks for classification fail to take into account the concept of the unknown. Trained neural networks are usually tested in an unrealistic scenario with only examples from a closed set of known classes. In an attempt to develop a more realistic model, the concept of working in an open set environment has been introduced. This in turn leads to the concept of incremental learning where a model with its own architecture and initial trained set of data can identify unknown classes during the testing phase and autonomously update itself if evidence of a new class is detected. Some problems that arise in incremental learning are inefficient use of resources to retrain the classifier repeatedly and the decrease of classification accuracy as multiple classes are added over time. This process of instantiating new classes is repeated as many times as necessary, accruing errors. To address these problems, this paper proposes the Classification Confidence Threshold approach to prime neural networks for incremental learning to keep accuracies high by limiting forgetting. A lean method is also used to reduce resources used in the retraining of the neural network. The proposed method is based on the idea that a network is able to incrementally learn a new class even when exposed to a limited number samples associated with the new class. This method can be applied to most existing neural networks with minimal changes to network architecture.



There are no comments yet.


page 1


Class-incremental Learning using a Sequence of Partial Implicitly Regularized Classifiers

In class-incremental learning, the objective is to learn a number of cla...

Moving Towards Open Set Incremental Learning: Readily Discovering New Authors

The classification of textual data often yields important information. M...

DeepStreamCE: A Streaming Approach to Concept Evolution Detection in Deep Neural Networks

Deep neural networks have experimentally demonstrated superior performan...

Collaborative Method for Incremental Learning on Classification and Generation

Although well-trained deep neural networks have shown remarkable perform...

Learning to Learn Image Classifiers with Informative Visual Analogy

In recent years, we witnessed a huge success of Convolutional Neural Net...

Class-incremental Learning with Pre-allocated Fixed Classifiers

In class-incremental learning, a learning agent faces a stream of data w...

Predicting Classification Accuracy when Adding New Unobserved Classes

Multiclass classifiers are often designed and evaluated only on a sample...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.