Discriminative Feature Learning through Feature Distance Loss

05/23/2022
by   Tobias Schlagenhauf, et al.
0

Convolutional neural networks have shown remarkable ability to learn discriminative semantic features in image recognition tasks. Though, for classification they often concentrate on specific regions in images. This work proposes a novel method that combines variant rich base models to concentrate on different important image regions for classification. A feature distance loss is implemented while training an ensemble of base models to force them to learn discriminative feature concepts. The experiments on benchmark convolutional neural networks (VGG16, ResNet, AlexNet), popular datasets (Cifar10, Cifar100, miniImageNet, NEU, BSD, TEX), and different training samples (3, 5, 10, 20, 50, 100 per class) show our methods effectiveness and generalization ability. Our method outperforms ensemble versions of the base models without feature distance loss, and the Class Activation Maps explicitly proves the ability to learn different discriminative feature concepts.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
06/30/2019

Learning to Find Correlated Features by Maximizing Information Flow in Convolutional Neural Networks

Training convolutional neural networks for image classification tasks us...
research
12/20/2018

One-Class Feature Learning Using Intra-Class Splitting

This paper proposes a novel generic one-class feature learning method wh...
research
06/24/2019

Mixup of Feature Maps in a Hidden Layer for Training of Convolutional Neural Network

The deep Convolutional Neural Network (CNN) became very popular as a fun...
research
04/22/2018

Anchor-based Nearest Class Mean Loss for Convolutional Neural Networks

Discriminative features are critical for machine learning applications. ...
research
04/19/2015

Visual Recognition Using Directional Distribution Distance

In computer vision, an entity such as an image or video is often represe...
research
12/16/2014

Locally Scale-Invariant Convolutional Neural Networks

Convolutional Neural Networks (ConvNets) have shown excellent results on...
research
06/05/2019

On the use of Pairwise Distance Learning for Brain Signal Classification with Limited Observations

The increasing access to brain signal data using electroencephalography ...

Please sign up or login with your details

Forgot password? Click here to reset