Adaptive Cost-sensitive Online Classification

04/06/2018
by   Peilin Zhao, et al.
0

Cost-Sensitive Online Classification has drawn extensive attention in recent years, where the main approach is to directly online optimize two well-known cost-sensitive metrics: (i) weighted sum of sensitivity and specificity; (ii) weighted misclassification cost. However, previous existing methods only considered first-order information of data stream. It is insufficient in practice, since many recent studies have proved that incorporating second-order information enhances the prediction performance of classification models. Thus, we propose a family of cost-sensitive online classification algorithms with adaptive regularization in this paper. We theoretically analyze the proposed algorithms and empirically validate their effectiveness and properties in extensive experiments. Then, for better trade off between the performance and efficiency, we further introduce the sketching technique into our algorithms, which significantly accelerates the computational speed with quite slight performance loss. Finally, we apply our algorithms to tackle several online anomaly detection tasks from real world. Promising results prove that the proposed algorithms are effective and efficient in solving cost-sensitive online classification problems in various real-world domains.

READ FULL TEXT
research
11/18/2019

Online Adaptive Asymmetric Active Learning with Limited Budgets

Online Active Learning (OAL) aims to manage unlabeled datastream by sele...
research
03/08/2020

Angle-Based Cost-Sensitive Multicategory Classification

Many real-world classification problems come with costs which can vary f...
research
03/30/2016

Cost-Sensitive Label Embedding for Multi-Label Classification

Label embedding (LE) is an important family of multi-label classificatio...
research
07/15/2015

Untangling AdaBoost-based Cost-Sensitive Classification. Part I: Theoretical Perspective

Boosting algorithms have been widely used to tackle a plethora of proble...
research
07/15/2015

Untangling AdaBoost-based Cost-Sensitive Classification. Part II: Empirical Analysis

A lot of approaches, each following a different strategy, have been prop...
research
04/03/2014

Kernel-Based Adaptive Online Reconstruction of Coverage Maps With Side Information

In this paper, we address the problem of reconstructing coverage maps fr...
research
11/07/2018

THORS: An Efficient Approach for Making Classifiers Cost-sensitive

In this paper, we propose an effective THresholding method based on ORde...

Please sign up or login with your details

Forgot password? Click here to reset