Anchor-based Nearest Class Mean Loss for Convolutional Neural Networks

04/22/2018
by   Fusheng Hao, et al.
0

Discriminative features are critical for machine learning applications. Most existing deep learning approaches, however, rely on convolutional neural networks (CNNs) for learning features, whose discriminant power is not explicitly enforced. In this paper, we propose a novel approach to train deep CNNs by imposing the intra-class compactness and the inter-class separability, so as to enhance the learned features' discriminant power. To this end, we introduce anchors, which are predefined vectors regarded as the centers for each class and fixed during training. Discriminative features are obtained by constraining the deep CNNs to map training samples to the corresponding anchors as close as possible. We propose two principles to select the anchors, and measure the proximity of two points using the Euclidean and cosine distance metric functions, which results in two novel loss functions. These loss functions require no sample pairs or triplets and can be efficiently optimized by batch stochastic gradient descent. We test the proposed method on three benchmark image classification datasets and demonstrate its promising results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2017

Contrastive-center loss for deep neural networks

The deep convolutional neural network(CNN) has significantly raised the ...
research
10/12/2020

CC-Loss: Channel Correlation Loss For Image Classification

The loss function is a key component in deep learning models. A commonly...
research
03/07/2018

Exponential Discriminative Metric Embedding in Deep Learning

With the remarkable success achieved by the Convolutional Neural Network...
research
04/25/2019

Learning Discriminative Features Via Weights-biased Softmax Loss

Loss functions play a key role in training superior deep neural networks...
research
06/06/2017

Deep Convolutional Decision Jungle for Image Classification

We propose a novel method called deep convolutional decision jungle (CDJ...
research
05/23/2022

Discriminative Feature Learning through Feature Distance Loss

Convolutional neural networks have shown remarkable ability to learn dis...
research
04/05/2020

Fisher Discriminant Triplet and Contrastive Losses for Training Siamese Networks

Siamese neural network is a very powerful architecture for both feature ...

Please sign up or login with your details

Forgot password? Click here to reset