Reduced-Rank Tensor-on-Tensor Regression and Tensor-variate Analysis of Variance

by   Carlos Llosa-Vite, et al.

Fitting regression models with many multivariate responses and covariates can be challenging, but such responses and covariates sometimes have tensor-variate structure. We extend the classical multivariate regression model to exploit such structure in two ways: first, we impose four types of low-rank tensor formats on the regression coefficients. Second, we model the errors using the tensor-variate normal distribution that imposes a Kronecker separable format on the covariance matrix. We obtain maximum likelihood estimators via block-relaxation algorithms and derive their asymptotic distributions. Our regression framework enables us to formulate tensor-variate analysis of variance (TANOVA) methodology. Application of our methodology in a one-way TANOVA layout enables us to identify cerebral regions significantly associated with the interaction of suicide attempters or non-attemptor ideators and positive-, negative- or death-connoting words. A separate application performs three-way TANOVA on the Labeled Faces in the Wild image database to distinguish facial characteristics related to ethnic origin, age group and gender.



There are no comments yet.


page 4

page 6

page 10

page 11

page 13

page 16

page 20

page 29


Joint estimation of sparse multivariate regression and conditional graphical models

Multivariate regression model is a natural generalization of the classic...

Multivariate functional responses low rank regression with an application to brain imaging data

We propose a multivariate functional responses low rank regression model...

Increasing Cluster Size Asymptotics for Nested Error Regression Models

This paper establishes asymptotic results for the maximum likelihood and...

A Statistically Identifiable Model for Tensor-Valued Gaussian Random Variables

Real-world signals typically span across multiple dimensions, that is, t...

Kriging in Tensor Train data format

Combination of low-tensor rank techniques and the Fast Fourier transform...

Prediction in polynomial errors-in-variables models

A multivariate errors-in-variables (EIV) model with an intercept term, a...

Multivariate Regression with Gross Errors on Manifold-valued Data

We consider the topic of multivariate regression on manifold-valued outp...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.