A weighted subspace exponential kernel for support tensor machines

by   Kirandeep Kour, et al.

High-dimensional data in the form of tensors are challenging for kernel classification methods. To both reduce the computational complexity and extract informative features, kernels based on low-rank tensor decompositions have been proposed. However, what decisive features of the tensors are exploited by these kernels is often unclear. In this paper we propose a novel kernel that is based on the Tucker decomposition. For this kernel the Tucker factors are computed based on re-weighting of the Tucker matrices with tuneable powers of singular values from the HOSVD decomposition. This provides a mechanism to balance the contribution of the Tucker core and factors of the data. We benchmark support tensor machines with this new kernel on several datasets. First we generate synthetic data where two classes differ in either Tucker factors or core, and compare our novel and previously existing kernels. We show robustness of the new kernel with respect to both classification scenarios. We further test the new method on real-world datasets. The proposed kernel has demonstrated a higher test accuracy than the state-of-the-art tensor train multi-way multi-level kernel, and a significantly lower computational time.


cuFasterTucker: A Stochastic Optimization Strategy for Parallel Sparse FastTucker Decomposition on GPU Platform

Currently, the size of scientific data is growing at an unprecedented ra...

Tensor machines for learning target-specific polynomial features

Recent years have demonstrated that using random feature maps can signif...

Multi-Tensor Network Representation for High-Order Tensor Completion

This work studies the problem of high-dimensional data (referred to tens...

Kernelized Support Tensor Train Machines

Tensor, a multi-dimensional data structure, has been exploited recently ...

Efficient Tensor Kernel methods for sparse regression

Recently, classical kernel methods have been extended by the introductio...

Efficient Structure-preserving Support Tensor Train Machine

Deploying the multi-relational tensor structure of a high dimensional fe...

Parallelized Tensor Train Learning of Polynomial Classifiers

In pattern classification, polynomial classifiers are well-studied metho...

Please sign up or login with your details

Forgot password? Click here to reset