Classification using Ensemble Learning under Weighted Misclassification Loss

12/16/2018
by   Yizhen Xu, et al.
0

Binary classification rules based on covariates typically depend on simple loss functions such as zero-one misclassification. Some cases may require more complex loss functions. For example, individual-level monitoring of HIV-infected individuals on antiretroviral therapy (ART) requires periodic assessment of treatment failure, defined as having a viral load (VL) value above a certain threshold. In some resource limited settings, VL tests may be limited by cost or technology, and diagnoses are based on other clinical markers. Depending on scenario, higher premium may be placed on avoiding false-positives which brings greater cost and reduced treatment options. Here, the optimal rule is determined by minimizing a weighted misclassification loss/risk. We propose a method for finding and cross-validating optimal binary classification rules under weighted misclassification loss. We focus on rules comprising a prediction score and an associated threshold, where the score is derived using an ensemble learner. Simulations and examples show that our method, which derives the score and threshold jointly, more accurately estimates overall risk and has better operating characteristics compared with methods that derive the score first and the cutoff conditionally on the score especially for finite samples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/29/2021

Score-oriented loss (SOL) functions

Loss functions engineering and the assessment of forecasting performance...
research
05/10/2019

Optimal rates for F-score binary classification

We study the minimax settings of binary classification with F-score unde...
research
10/01/2015

Optimal Binary Classifier Aggregation for General Losses

We address the problem of aggregating an ensemble of predictors with kno...
research
06/02/2018

Binary Classification with Karmic, Threshold-Quasi-Concave Metrics

Complex performance measures, beyond the popular measure of accuracy, ar...
research
03/18/2022

Decision-Making under Miscalibration

ML-based predictions are used to inform consequential decisions about in...
research
05/31/2021

Predicting Chronic Homelessness: The Importance of Comparing Algorithms using Client Histories

This paper investigates how to best compare algorithms for predicting ch...
research
03/16/2021

Learning to increase matching efficiency in identifying additional b-jets in the tt̅bb̅ process

The tt̅H(bb̅) process is an essential channel to reveal the Higgs proper...

Please sign up or login with your details

Forgot password? Click here to reset