On Extending Neural Networks with Loss Ensembles for Text Classification

11/14/2017
by   Hamideh Hajiabadi, et al.
0

Ensemble techniques are powerful approaches that combine several weak learners to build a stronger one. As a meta learning framework, ensemble techniques can easily be applied to many machine learning techniques. In this paper we propose a neural network extended with an ensemble loss function for text classification. The weight of each weak loss function is tuned within the training phase through the gradient propagation optimization method of the neural network. The approach is evaluated on several text classification datasets. We also evaluate its performance in various environments with several degrees of label noise. Experimental results indicate an improvement of the results and strong resilience against label noise in comparison with other methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2018

RELF: Robust Regression Extended with Ensemble Loss Function

Ensemble techniques are powerful approaches that combine several weak le...
research
05/20/2018

Abstractive Text Classification Using Sequence-to-convolution Neural Networks

We propose a new deep neural network model and its training scheme for t...
research
03/18/2019

An Effective Label Noise Model for DNN Text Classification

Because large, human-annotated datasets suffer from labeling errors, it ...
research
10/18/2021

Noise-Resilient Ensemble Learning using Evidence Accumulation Clustering

Ensemble Learning methods combine multiple algorithms performing the sam...
research
04/20/2022

Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification

Incorrect labels in training data occur when human annotators make mista...
research
05/02/2020

Single Model Ensemble using Pseudo-Tags and Distinct Vectors

Model ensemble techniques often increase task performance in neural netw...
research
10/25/2017

Exploring the Use of Text Classification in the Legal Domain

In this paper, we investigate the application of text classification met...

Please sign up or login with your details

Forgot password? Click here to reset