DeepAI AI Chat
Log In Sign Up

Alternating direction method of multipliers for regularized multiclass support vector machines

by   Yangyang Xu, et al.
Rice University

The support vector machine (SVM) was originally designed for binary classifications. A lot of effort has been put to generalize the binary SVM to multiclass SVM (MSVM) which are more complex problems. Initially, MSVMs were solved by considering their dual formulations which are quadratic programs and can be solved by standard second-order methods. However, the duals of MSVMs with regularizers are usually more difficult to formulate and computationally very expensive to solve. This paper focuses on several regularized MSVMs and extends the alternating direction method of multiplier (ADMM) to these MSVMs. Using a splitting technique, all considered MSVMs are written as two-block convex programs, for which the ADMM has global convergence guarantees. Numerical experiments on synthetic and real data demonstrate the high efficiency and accuracy of our algorithms.


page 1

page 2

page 3

page 4


Proximal gradient method for huberized support vector machine

The Support Vector Machine (SVM) has been used in a wide variety of clas...

An ADMM Solver for the MKL-L_0/1-SVM

We formulate the Multiple Kernel Learning (abbreviated as MKL) problem f...


This paper presents a Multiple Kernel Learning (abbreviated as MKL) fram...

HIPAD - A Hybrid Interior-Point Alternating Direction algorithm for knowledge-based SVM and feature selection

We consider classification tasks in the regime of scarce labeled trainin...

Splitting Method for Support Vector Machine with Lower Semi-continuous Loss

In this paper, we study the splitting method based on alternating direct...

A Hardware-Efficient ADMM-Based SVM Training Algorithm for Edge Computing

This work demonstrates a hardware-efficient support vector machine (SVM)...

Sparse Universum Quadratic Surface Support Vector Machine Models for Binary Classification

In binary classification, kernel-free linear or quadratic support vector...