Soft-SVM Regression For Binary Classification

05/24/2022
by   Man Huang, et al.
0

The binomial deviance and the SVM hinge loss functions are two of the most widely used loss functions in machine learning. While there are many similarities between them, they also have their own strengths when dealing with different types of data. In this work, we introduce a new exponential family based on a convex relaxation of the hinge loss function using softness and class-separation parameters. This new family, denoted Soft-SVM, allows us to prescribe a generalized linear model that effectively bridges between logistic regression and SVM classification. This new model is interpretable and avoids data separability issues, attaining good fitting and predictive performance by automatically adjusting for data label separability via the softness parameter. These results are confirmed empirically through simulations and case studies as we compare regularized logistic, SVM, and Soft-SVM regressions and conclude that the proposed model performs well in terms of both classification and prediction errors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2019

Logitron: Perceptron-augmented classification model based on an extended logistic loss function

Classification is the most important process in data analysis. However, ...
research
01/18/2023

An Analysis of Loss Functions for Binary Classification and Regression

This paper explores connections between margin-based loss functions and ...
research
07/16/2019

The Bregman-Tweedie Classification Model

This work proposes the Bregman-Tweedie classification model and analyzes...
research
02/09/2021

Learning a powerful SVM using piece-wise linear loss functions

In this paper, we have considered general k-piece-wise linear convex los...
research
05/24/2017

Learning with Average Top-k Loss

In this work, we introduce the average top-k (AT_k) loss as a new ensemb...
research
09/05/2023

RoBoSS: A Robust, Bounded, Sparse, and Smooth Loss Function for Supervised Learning

In the domain of machine learning algorithms, the significance of the lo...
research
09/21/2019

Single Class Universum-SVM

This paper extends the idea of Universum learning [1, 2] to single-class...

Please sign up or login with your details

Forgot password? Click here to reset