DeepAI AI Chat
Log In Sign Up

Bayesian inverse regression for supervised dimension reduction with small datasets

by   Xin Cai, et al.
Purdue University
University of Liverpool
Shanghai Jiao Tong University

We consider supervised dimension reduction problems, namely to identify a low dimensional projection of the predictors x which can retain the statistical relationship between x and the response variable y. We follow the idea of the sliced inverse regression (SIR) class of methods, which is to use the statistical information of the conditional distribution π(x|y) to identify the dimension reduction (DR) space and in particular we focus on the task of computing this conditional distribution. We propose a Bayesian framework to compute the conditional distribution where the likelihood function is obtained using the Gaussian process regression model. The conditional distribution π(x|y) can then be obtained directly by assigning weights to the original data points. We then can perform DR by considering certain moment functions (e.g. the first moment) of the samples of the posterior distribution. With numerical examples, we demonstrate that the proposed method is especially effective for small data problems.


page 1

page 2

page 3

page 4


Conditional Variance Estimator for Sufficient Dimension Reduction

Conditional Variance Estimation (CVE) is a novel sufficient dimension re...

Central Quantile Subspace

Quantile regression (QR) is becoming increasingly popular due to its rel...

Ensemble Conditional Variance Estimator for Sufficient Dimension Reduction

Ensemble Conditional Variance Estimation (ECVE) is a novel sufficient di...

Data-Free Likelihood-Informed Dimension Reduction of Bayesian Inverse Problems

Identifying a low-dimensional informed parameter subspace offers a viabl...

Tail inverse regression for dimension reduction with extreme response

We consider the problem of dimensionality reduction for prediction of a ...

A Probabilistic Graph Coupling View of Dimension Reduction

Most popular dimension reduction (DR) methods like t-SNE and UMAP are ba...

Inverse Moment Methods for Sufficient Forecasting using High-Dimensional Predictors

We consider forecasting a single time series using high-dimensional pred...