Tensor-on-tensor regression

01/04/2017
by   Eric F. Lock, et al.
0

We propose a framework for the linear prediction of a multi-way array (i.e., a tensor) from another multi-way array of arbitrary dimension, using the contracted tensor product. This framework generalizes several existing approaches, including methods to predict a scalar outcome from a tensor, a matrix from a matrix, or a tensor from a scalar. We describe an approach that exploits the multiway structure of both the predictors and the outcomes by restricting the coefficients to have reduced CP-rank. We propose a general and efficient algorithm for penalized least-squares estimation, which allows for a ridge (L_2) penalty on the coefficients. The objective is shown to give the mode of a Bayesian posterior, which motivates a Gibbs sampling algorithm for inference. We illustrate the approach with an application to facial image data. An R package is available at https://github.com/lockEF/MultiwayRegression .

READ FULL TEXT

page 13

page 14

page 15

research
08/05/2022

Bayesian predictive modeling of multi-source multi-way data

We develop a Bayesian approach to predict a continuous or binary outcome...
research
09/11/2016

Supervised multiway factorization

We describe a probabilistic PARAFAC/CANDECOMP (CP) factorization for mul...
research
01/31/2019

Bayesian nonparametric multiway regression for clustered binomial data

We introduce a Bayesian nonparametric regression model for data with mul...
research
10/12/2015

Penalized estimation in large-scale generalized linear array models

Large-scale generalized linear array models (GLAMs) can be challenging t...
research
10/24/2022

Deep Kronecker Network

We propose Deep Kronecker Network (DKN), a novel framework designed for ...
research
10/21/2019

Soft Tensor Regression

Statistical methods relating tensor predictors to scalar outcomes in a r...
research
09/27/2017

Multi-way Interacting Regression via Factorization Machines

We propose a Bayesian regression method that accounts for multi-way inte...

Please sign up or login with your details

Forgot password? Click here to reset