Multi-class Active Learning: A Hybrid Informative and Representative Criterion Inspired Approach

03/06/2018
by   Xi Fang, et al.
0

Labeling each instance in a large dataset is extremely labor- and time- consuming . One way to alleviate this problem is active learning, which aims to which discover the most valuable instances for labeling to construct a powerful classifier. Considering both informativeness and representativeness provides a promising way to design a practical active learning. However, most existing active learning methods select instances favoring either informativeness or representativeness. Meanwhile, many are designed based on the binary class, so that they may present suboptimal solutions on the datasets with multiple classes. In this paper, a hybrid informative and representative criterion based multi-class active learning approach is proposed. We combine the informative informativeness and representativeness into one formula, which can be solved under a unified framework. The informativeness is measured by the margin minimum while the representative information is measured by the maximum mean discrepancy. By minimizing the upper bound for the true risk, we generalize the empirical risk minimization principle to the active learning setting. Simultaneously, our proposed method makes full use of the label information, and the proposed active learning is designed based on multiple classes. So the proposed method is not suitable to the binary class but also the multiple classes. We conduct our experiments on twelve benchmark UCI data sets, and the experimental results demonstrate that the proposed method performs better than some state-of-the-art methods.

READ FULL TEXT

page 3

page 4

research
10/09/2021

Class-Balanced Active Learning for Image Classification

Active learning aims to reduce the labeling effort that is required to t...
research
03/17/2022

Nearest Neighbor Classifier with Margin Penalty for Active Learning

As deep learning becomes the mainstream in the field of natural language...
research
05/29/2019

Active Learning in the Overparameterized and Interpolating Regime

Overparameterized models that interpolate training data often display su...
research
11/24/2022

Responsible Active Learning via Human-in-the-loop Peer Study

Active learning has been proposed to reduce data annotation efforts by o...
research
05/15/2020

Stopping criterion for active learning based on deterministic generalization bounds

Active learning is a framework in which the learning machine can select ...
research
11/18/2022

Active Learning by Query by Committee with Robust Divergences

Active learning is a widely used methodology for various problems with h...
research
10/02/2022

Improved Algorithms for Neural Active Learning

We improve the theoretical and empirical performance of neural-network(N...

Please sign up or login with your details

Forgot password? Click here to reset