Multiple Output Regression with Latent Noise

10/27/2014
by   Jussi Gillberg, et al.
0

In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal. Therefore, (1) explaining away the structured noise in multiple-output regression is of paramount importance. Additionally, (2) assumptions about the correlation structure of the regression weights are needed. We note that both can be formulated in a natural way in a latent variable model, in which both the interesting signal and the noise are mediated through the same latent factors. Under this assumption, the signal model then borrows strength from the noise model by encouraging similar effects on correlated targets. We introduce a hyperparameter for the latent signal-to-noise ratio which turns out to be important for modelling weak signals, and an ordered infinite-dimensional shrinkage prior that resolves the rotational unidentifiability in reduced-rank regression models. Simulations and prediction experiments with metabolite, gene expression, FMRI measurement, and macroeconomic time series data show that our model equals or exceeds the state-of-the-art performance and, in particular, outperforms the standard approach of assuming independent noise and signal models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2015

Classification of weak multi-view signals by sharing factors in a mixture of Bayesian group factor analyzers

We propose a novel classification model for weak signal data, building u...
research
11/08/2021

Statistical properties of large data sets with linear latent features

Analytical understanding of how low-dimensional latent features reveal t...
research
04/13/2023

Signal identification without signal formulation

When there are signals and noises, physicists try to identify signals by...
research
09/12/2022

Amortised Inference in Structured Generative Models with Explaining Away

A key goal of unsupervised learning is to go beyond density estimation a...
research
07/14/2020

The impact of signal-to-noise, redshift, and angular range on the bias of weak lensing 2-point functions

Weak lensing data follow a naturally skewed distribution, implying the d...
research
01/06/2023

Isotonic Recalibration under a Low Signal-to-Noise Ratio

Insurance pricing systems should fulfill the auto-calibration property t...
research
10/17/2021

Exploitation of error correlation in a large analysis validation: GlobCurrent case study

An assessment of variance in ocean current signal and noise shared by in...

Please sign up or login with your details

Forgot password? Click here to reset