Cost-Sensitive Deep Learning with Layer-Wise Cost Estimation

11/16/2016
by   Yu-An Chung, et al.
0

While deep neural networks have succeeded in several visual applications, such as object recognition, detection, and localization, by reaching very high classification accuracies, it is important to note that many real-world applications demand vary- ing costs for different types of misclassification errors, thus requiring cost-sensitive classification algorithms. Current models of deep neural networks for cost-sensitive classification are restricted to some specific network structures and limited depth. In this paper, we propose a novel framework that can be applied to deep neural networks with any structure to facilitate their learning of meaningful representations for cost-sensitive classification problems. Furthermore, the framework allows end- to-end training of deeper networks directly. The framework is designed by augmenting auxiliary neurons to the output of each hidden layer for layer-wise cost estimation, and including the total estimation loss within the optimization objective. Experimental results on public benchmark visual data sets with two cost information settings demonstrate that the proposed frame- work outperforms state-of-the-art cost-sensitive deep learning models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/08/2020

Angle-Based Cost-Sensitive Multicategory Classification

Many real-world classification problems come with costs which can vary f...
research
11/30/2015

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning

Deep learning has been one of the most prominent machine learning techni...
research
02/07/2021

An Analytic Layer-wise Deep Learning Framework with Applications to Robotics

Deep learning has achieved great success in many applications, but it ha...
research
07/14/2020

Misclassification cost-sensitive ensemble learning: A unifying framework

Over the years, a plethora of cost-sensitive methods have been proposed ...
research
04/25/2018

Learnable Histogram: Statistical Context Features for Deep Neural Networks

Statistical features, such as histogram, Bag-of-Words (BoW) and Fisher V...
research
08/25/2020

Sensitive Information Detection: Recursive Neural Networks for Encoding Context

The amount of data for processing and categorization grows at an ever in...
research
07/05/2017

Data-Driven Sparse Structure Selection for Deep Neural Networks

Deep convolutional neural networks have liberated its extraordinary powe...

Please sign up or login with your details

Forgot password? Click here to reset