A weighted subspace exponential kernel for support tensor machines

02/16/2023
by   Kirandeep Kour, et al.
0

High-dimensional data in the form of tensors are challenging for kernel classification methods. To both reduce the computational complexity and extract informative features, kernels based on low-rank tensor decompositions have been proposed. However, what decisive features of the tensors are exploited by these kernels is often unclear. In this paper we propose a novel kernel that is based on the Tucker decomposition. For this kernel the Tucker factors are computed based on re-weighting of the Tucker matrices with tuneable powers of singular values from the HOSVD decomposition. This provides a mechanism to balance the contribution of the Tucker core and factors of the data. We benchmark support tensor machines with this new kernel on several datasets. First we generate synthetic data where two classes differ in either Tucker factors or core, and compare our novel and previously existing kernels. We show robustness of the new kernel with respect to both classification scenarios. We further test the new method on real-world datasets. The proposed kernel has demonstrated a higher test accuracy than the state-of-the-art tensor train multi-way multi-level kernel, and a significantly lower computational time.

READ FULL TEXT
research
10/12/2022

cuFasterTucker: A Stochastic Optimization Strategy for Parallel Sparse FastTucker Decomposition on GPU Platform

Currently, the size of scientific data is growing at an unprecedented ra...
research
04/07/2015

Tensor machines for learning target-specific polynomial features

Recent years have demonstrated that using random feature maps can signif...
research
09/09/2021

Multi-Tensor Network Representation for High-Order Tensor Completion

This work studies the problem of high-dimensional data (referred to tens...
research
01/02/2020

Kernelized Support Tensor Train Machines

Tensor, a multi-dimensional data structure, has been exploited recently ...
research
03/23/2020

Efficient Tensor Kernel methods for sparse regression

Recently, classical kernel methods have been extended by the introductio...
research
02/12/2020

Efficient Structure-preserving Support Tensor Train Machine

Deploying the multi-relational tensor structure of a high dimensional fe...
research
12/20/2016

Parallelized Tensor Train Learning of Polynomial Classifiers

In pattern classification, polynomial classifiers are well-studied metho...

Please sign up or login with your details

Forgot password? Click here to reset