Receiver Operating Characteristic Curves and Confidence Bands for Support Vector Machines

07/17/2018
by   Daniel J. Luckett, et al.
0

Many problems that appear in biomedical decision making, such as diagnosing disease and predicting response to treatment, can be expressed as binary classification problems. The costs of false positives and false negatives vary across application domains and receiver operating characteristic (ROC) curves provide a visual representation of this trade-off. Nonparametric estimators for the ROC curve, such as a weighted support vector machine (SVM), are desirable because they are robust to model misspecification. While weighted SVMs have great potential for estimating ROC curves, their theoretical properties were heretofore underdeveloped. We propose a method for constructing confidence bands for the SVM ROC curve and provide the theoretical justification for the SVM ROC curve by showing that the risk function of the estimated decision rule is uniformly consistent across the weight parameter. We demonstrate the proposed confidence band method and the superior sensitivity and specificity of the weighted SVM compared to commonly used methods in diagnostic medicine using simulation studies. We present two illustrative examples: diagnosis of hepatitis C and a predictive model for treatment response in breast cancer.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2019

Decision Making with Machine Learning and ROC Curves

The Receiver Operating Characteristic (ROC) curve is a representation of...
research
03/12/2019

Neyman-Pearson Criterion (NPC): A Model Selection Criterion for Asymmetric Binary Classification

We propose a new model selection criterion, the Neyman-Pearson criterion...
research
07/23/2020

A binary-response regression model based on support vector machines

The soft-margin support vector machine (SVM) is a ubiquitous tool for pr...
research
05/12/2017

Detection of irregular QRS complexes using Hermite Transform and Support Vector Machine

Computer based recognition and detection of abnormalities in ECG signals...
research
02/23/2021

Estimating Average Treatment Effects with Support Vector Machines

Support vector machine (SVM) is one of the most popular classification a...
research
04/08/2019

Early warning in egg production curves from commercial hens: A SVM approach

Artificial Intelligence allows the improvement of our daily life, for in...
research
07/15/2020

Statistical Evaluation of Medical Tests

In this review, we present an overview of the main aspects related to th...

Please sign up or login with your details

Forgot password? Click here to reset