Data Integration with High Dimensionality

10/03/2016
by   Xin Gao, et al.
0

We consider a problem of data integration. Consider determining which genes affect a disease. The genes, which we call predictor objects, can be measured in different experiments on the same individual. We address the question of finding which genes are predictors of disease by any of the experiments. Our formulation is more general. In a given data set, there are a fixed number of responses for each individual, which may include a mix of discrete, binary and continuous variables. There is also a class of predictor objects, which may differ within a subject depending on how the predictor object is measured, i.e., depend on the experiment. The goal is to select which predictor objects affect any of the responses, where the number of such informative predictor objects or features tends to infinity as sample size increases. There are marginal likelihoods for each way the predictor object is measured, i.e., for each experiment. We specify a pseudolikelihood combining the marginal likelihoods, and propose a pseudolikelihood information criterion. Under regularity conditions, we establish selection consistency for the pseudolikelihood information criterion with unbounded true model size, which includes a Bayesian information criterion with appropriate penalty term as a special case. Simulations indicate that data integration improves upon, sometimes dramatically, using only one of the data sources.

READ FULL TEXT
research
06/29/2020

Data integration in high dimension with multiple quantiles

This article deals with the analysis of high dimensional data that come ...
research
08/11/2015

Bridging AIC and BIC: a new criterion for autoregression

We introduce a new criterion to determine the order of an autoregressive...
research
01/10/2013

Classifier Learning with Supervised Marginal Likelihood

It has been argued that in supervised classification tasks, in practice ...
research
04/09/2023

Maximum Agreement Linear Prediction via the Concordance Correlation Coefficient

This paper examines distributional properties and predictive performance...
research
09/05/2011

ShareBoost: Efficient Multiclass Learning with Feature Sharing

Multiclass prediction is the problem of classifying an object into a rel...
research
10/23/2022

A dichotomous behavior of Guttman-Kaiser criterion from equi-correlated normal population

We consider a p-dimensional, centered normal population such that all va...
research
12/20/2018

Finite-time optimality of Bayesian predictors

The problem of sequential probability forecasting is considered in the m...

Please sign up or login with your details

Forgot password? Click here to reset