Stopping Active Learning based on Predicted Change of F Measure for Text Classification

01/26/2019
by   Michael Altschuler, et al.
0

During active learning, an effective stopping method allows users to limit the number of annotations, which is cost effective. In this paper, a new stopping method called Predicted Change of F Measure will be introduced that attempts to provide the users an estimate of how much performance of the model is changing at each iteration. This stopping method can be applied with any base learner. This method is useful for reducing the data annotation bottleneck encountered when building text classification systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/26/2019

The Use of Unlabeled Data versus Labeled Data for Stopping Active Learning for Text Classification

Annotation of training data is the major bottleneck in the creation of t...
research
01/20/2020

Early Forecasting of Text Classification Accuracy and F-Measure with Active Learning

When creating text classification systems, one of the major bottlenecks ...
research
01/24/2018

Impact of Batch Size on Stopping Active Learning for Text Classification

When using active learning, smaller batch sizes are typically more effic...
research
01/08/2022

Impact of Stop Sets on Stopping Active Learning for Text Classification

Active learning is an increasingly important branch of machine learning ...
research
04/23/2015

Analysis of Stopping Active Learning based on Stabilizing Predictions

Within the natural language processing (NLP) community, active learning ...
research
08/06/2020

Fast Approximate Modelling of the Next Combination Result for Stopping the Text Recognition in a Video

In this paper, we consider a task of stopping the video stream recogniti...
research
04/09/2015

Deciding when to stop: Efficient stopping of active learning guided drug-target prediction

Active learning has shown to reduce the number of experiments needed to ...

Please sign up or login with your details

Forgot password? Click here to reset