Theoretical and Experimental Analyses of Tensor-Based Regression and Classification

09/06/2015
by   Kishan Wimalawarne, et al.
0

We theoretically and experimentally investigate tensor-based regression and classification. Our focus is regularization with various tensor norms, including the overlapped trace norm, the latent trace norm, and the scaled latent trace norm. We first give dual optimization methods using the alternating direction method of multipliers, which is computationally efficient when the number of training samples is moderate. We then theoretically derive an excess risk bound for each tensor norm and clarify their behavior. Finally, we perform extensive experiments using simulated and real data and demonstrate the superiority of tensor-based learning methods over vector- and matrix-based learning methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/17/2013

A New Convex Relaxation for Tensor Completion

We study the problem of learning a tensor from a set of linear measureme...
research
12/26/2015

Regularized Orthogonal Tensor Decompositions for Multi-Relational Learning

Multi-relational learning has received lots of attention from researcher...
research
02/12/2020

Deep Multi-Task Learning via Generalized Tensor Trace Norm

The trace norm is widely used in multi-task learning as it can discover ...
research
07/19/2020

A Flexible Optimization Framework for Regularized Matrix-Tensor Factorizations with Linear Couplings

Coupled matrix and tensor factorizations (CMTF) are frequently used to j...
research
10/18/2012

Matrix reconstruction with the local max norm

We introduce a new family of matrix norms, the "local max" norms, genera...
research
03/26/2013

Convex Tensor Decomposition via Structured Schatten Norm Regularization

We discuss structured Schatten norms for tensor decomposition that inclu...
research
07/18/2017

Solving ℓ^p-norm regularization with tensor kernels

In this paper, we discuss how a suitable family of tensor kernels can be...

Please sign up or login with your details

Forgot password? Click here to reset