Reduced-Rank Tensor-on-Tensor Regression and Tensor-variate Analysis of Variance

12/18/2020
by   Carlos Llosa-Vite, et al.
11

Fitting regression models with many multivariate responses and covariates can be challenging, but such responses and covariates sometimes have tensor-variate structure. We extend the classical multivariate regression model to exploit such structure in two ways: first, we impose four types of low-rank tensor formats on the regression coefficients. Second, we model the errors using the tensor-variate normal distribution that imposes a Kronecker separable format on the covariance matrix. We obtain maximum likelihood estimators via block-relaxation algorithms and derive their asymptotic distributions. Our regression framework enables us to formulate tensor-variate analysis of variance (TANOVA) methodology. Application of our methodology in a one-way TANOVA layout enables us to identify cerebral regions significantly associated with the interaction of suicide attempters or non-attemptor ideators and positive-, negative- or death-connoting words. A separate application performs three-way TANOVA on the Labeled Faces in the Wild image database to distinguish facial characteristics related to ethnic origin, age group and gender.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 6

page 10

page 11

page 13

page 16

page 20

page 29

06/19/2013

Joint estimation of sparse multivariate regression and conditional graphical models

Multivariate regression model is a natural generalization of the classic...
10/08/2020

Multivariate functional responses low rank regression with an application to brain imaging data

We propose a multivariate functional responses low rank regression model...
01/22/2021

Increasing Cluster Size Asymptotics for Nested Error Regression Models

This paper establishes asymptotic results for the maximum likelihood and...
11/07/2019

A Statistically Identifiable Model for Tensor-Valued Gaussian Random Variables

Real-world signals typically span across multiple dimensions, that is, t...
04/21/2019

Kriging in Tensor Train data format

Combination of low-tensor rank techniques and the Fast Fourier transform...
06/26/2020

Prediction in polynomial errors-in-variables models

A multivariate errors-in-variables (EIV) model with an intercept term, a...
03/26/2017

Multivariate Regression with Gross Errors on Manifold-valued Data

We consider the topic of multivariate regression on manifold-valued outp...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.