DeepAI
Log In Sign Up

Kernelized Support Tensor Train Machines

01/02/2020
by   Cong Chen, et al.
15

Tensor, a multi-dimensional data structure, has been exploited recently in the machine learning community. Traditional machine learning approaches are vector- or matrix-based, and cannot handle tensorial data directly. In this paper, we propose a tensor train (TT)-based kernel technique for the first time, and apply it to the conventional support vector machine (SVM) for image classification. Specifically, we propose a kernelized support tensor train machine that accepts tensorial input and preserves the intrinsic kernel property. The main contributions are threefold. First, we propose a TT-based feature mapping procedure that maintains the TT structure in the feature space. Second, we demonstrate two ways to construct the TT-based kernel function while considering consistency with the TT inner product and preservation of information. Third, we show that it is possible to apply different kernel functions on different data modes. In principle, our method tensorizes the standard SVM on its input structure and kernel mapping scheme. Extensive experiments are performed on real-world tensor data, which demonstrates the superiority of the proposed scheme under few-sample high-dimensional inputs.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/17/2018

A Support Tensor Train Machine

There has been growing interest in extending traditional vector-based ma...
02/12/2020

Efficient Structure-preserving Support Tensor Train Machine

Deploying the multi-relational tensor structure of a high dimensional fe...
02/29/2020

An End-to-End Graph Convolutional Kernel Support Vector Machine

A novel kernel-based support vector machine (SVM) for graph classificati...
07/20/2017

A Nonlinear Kernel Support Matrix Machine for Matrix Learning

Tensor is a natural and compact representation for real world data which...
02/29/2012

Learning from Distributions via Support Measure Machines

This paper presents a kernel-based discriminative learning framework on ...
07/05/2022

Automatic inspection of cultural monuments using deep and tensor-based learning on hyperspectral imagery

In Cultural Heritage, hyperspectral images are commonly used since they ...
05/15/2011

Spectrum Sensing for Cognitive Radio Using Kernel-Based Learning

Kernel method is a very powerful tool in machine learning. The trick of ...