Large Scale Tensor Regression using Kernels and Variational Inference

02/11/2020
by   Robert Hu, et al.
24

We outline an inherent weakness of tensor factorization models when latent factors are expressed as a function of side information and propose a novel method to mitigate this weakness. We coin our method Kernel Fried Tensor(KFT) and present it as a large scale forecasting tool for high dimensional data. Our results show superior performance against LightGBM and Field Aware Factorization Machines(FFM), two algorithms with proven track records widely used in industrial forecasting. We also develop a variational inference framework for KFT and associate our forecasts with calibrated uncertainty estimates on three large scale datasets. Furthermore, KFT is empirically shown to be robust against uninformative side information in terms of constants and Gaussian noise.

READ FULL TEXT

page 18

page 19

research
09/29/2014

A Bayesian Tensor Factorization Model via Variational Inference for Link Prediction

Probabilistic approaches for tensor factorization aim to extract meaning...
research
11/28/2017

Variational Inference for Gaussian Process Models with Linear Complexity

Large-scale Gaussian process inference has long faced practical challeng...
research
06/12/2019

Neural Variational Inference For Estimating Uncertainty in Knowledge Graph Embeddings

Recent advances in Neural Variational Inference allowed for a renaissanc...
research
05/03/2023

Tensorizing flows: a tool for variational inference

Fueled by the expressive power of deep neural networks, normalizing flow...
research
11/12/2013

DinTucker: Scaling up Gaussian process models on multidimensional arrays with billions of elements

Infinite Tucker Decomposition (InfTucker) and random function prior mode...
research
06/18/2021

Bayesian Cox Regression for Population-scale Inference in Electronic Health Records

The Cox model is an indispensable tool for time-to-event analysis, parti...
research
12/01/2015

Highly Scalable Tensor Factorization for Prediction of Drug-Protein Interaction Type

The understanding of the type of inhibitory interaction plays an importa...

Please sign up or login with your details

Forgot password? Click here to reset