m-arcsinh: An Efficient and Reliable Function for SVM and MLP in scikit-learn

09/16/2020
by   Luca Parisi, PhD, MBA Candidate, et al.
13

This paper describes the 'm-arcsinh', a modified ('m-') version of the inverse hyperbolic sine function ('arcsinh'). Kernel and activation functions enable Machine Learning (ML)-based algorithms, such as Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP), to learn from data in a supervised manner. m-arcsinh, implemented in the open source Python library 'scikit-learn', is hereby presented as an efficient and reliable kernel and activation function for SVM and MLP respectively. Improvements in reliability and speed to convergence in classification tasks on fifteen (N = 15) datasets available from scikit-learn and the University California Irvine (UCI) Machine Learning repository are discussed. Experimental results demonstrate the overall competitive classification performance of both SVM and MLP, achieved via the proposed function. This function is compared to gold standard kernel and activation functions, demonstrating its overall competitive reliability regardless of the complexity of the classification tasks involved.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/15/2020

hyper-sinh: An Accurate and Reliable Function from Shallow to Deep Learning in TensorFlow and Keras

This paper presents the 'hyper-sinh', a variation of the m-arcsinh activ...
08/17/2021

M-ar-K-Fast Independent Component Analysis

This study presents the m-arcsinh Kernel ('m-ar-K') Fast Independent Com...
02/29/2020

An End-to-End Graph Convolutional Kernel Support Vector Machine

A novel kernel-based support vector machine (SVM) for graph classificati...
01/17/2019

Activation Functions for Generalized Learning Vector Quantization - A Performance Comparison

An appropriate choice of the activation function (like ReLU, sigmoid or ...
07/20/2020

MKLpy: a python-based framework for Multiple Kernel Learning

Multiple Kernel Learning is a recent and powerful paradigm to learn the ...
04/24/2019

Comparing machine learning models to choose the variable ordering for cylindrical algebraic decomposition

There has been recent interest in the use of machine learning (ML) appro...
02/12/2020

Efficient Structure-preserving Support Tensor Train Machine

Deploying the multi-relational tensor structure of a high dimensional fe...

Code Repositories

m-arcsinh_scikit-learn_TensorFlow_Keras

m-arcsinh: An Efficient and Reliable Activation Function for Machine Learning in scikit-learn, TensorFlow, and Keras


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.