A Study of Deep CNN Model with Labeling Noise Based on Granular-ball Computing

07/17/2022
by   Dawei Dai, et al.
0

In supervised learning, the presence of noise can have a significant impact on decision making. Since many classifiers do not take label noise into account in the derivation of the loss function, including the loss functions of logistic regression, SVM, and AdaBoost, especially the AdaBoost iterative algorithm, whose core idea is to continuously increase the weight value of the misclassified samples, the weight of samples in many presence of label noise will be increased, leading to a decrease in model accuracy. In addition, the learning process of BP neural network and decision tree will also be affected by label noise. Therefore, solving the label noise problem is an important element of maintaining the robustness of the network model, which is of great practical significance. Granular ball computing is an important modeling method developed in the field of granular computing in recent years, which is an efficient, robust and scalable learning method. In this paper, we pioneered a granular ball neural network algorithm model, which adopts the idea of multi-granular to filter label noise samples during model training, solving the current problem of model instability caused by label noise in the field of deep learning, greatly reducing the proportion of label noise in training samples and improving the robustness of neural network models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2021

Contrastive Learning Improves Model Robustness Under Label Noise

Deep neural network-based classifiers trained with the categorical cross...
research
11/28/2022

Establishment of Neural Networks Robust to Label Noise

Label noise is a significant obstacle in deep learning model training. I...
research
09/17/2022

Computed Decision Weights and a New Learning Algorithm for Neural Classifiers

In this paper we consider the possibility of computing rather than train...
research
10/28/2022

The Fisher-Rao Loss for Learning under Label Noise

Choosing a suitable loss function is essential when learning by empirica...
research
07/13/2020

TrustNet: Learning from Trusted Data Against (A)symmetric Label Noise

Robustness to label noise is a critical property for weakly-supervised c...
research
10/21/2022

Fuzzy Granular-Ball Computing Framework and Its Implementation in SVM

Most existing fuzzy computing methods use points as input, which is the ...
research
03/21/2023

Dynamic-Aware Loss for Learning with Label Noise

Label noise poses a serious threat to deep neural networks (DNNs). Emplo...

Please sign up or login with your details

Forgot password? Click here to reset