DeepAI AI Chat
Log In Sign Up

Inference from Non-Random Samples Using Bayesian Machine Learning

04/12/2021
by   Yutao Liu, et al.
0

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized prediction approach that predicts the outcomes in the population using a large number of auxiliary variables such that the ignorability assumption is reasonable while the Bayesian framework is straightforward for quantification of uncertainty. Besides the auxiliary variables, inspired by Little An (2004), we also extend the approach by estimating the propensity score for a unit to be included in the sample and also including it as a predictor in the machine learning models. We show through simulation studies that the regularized predictions using soft Bayesian additive regression trees yield valid inference for the population means and coverage rates close to the nominal levels. We demonstrate the application of the proposed methods using two different real data applications, one in a survey and one in an epidemiology study.

READ FULL TEXT

page 14

page 20

06/11/2019

An approximate Bayesian approach to regression estimation with many auxiliary variables

Model-assisted estimation with complex survey data is an important pract...
05/16/2018

Doubly Robust Inference with Non-probability Survey Samples

We establish a general framework for statistical inferences with non-pro...
01/15/2020

Generalized Bayesian Quantification Learning

Quantification Learning is the task of prevalence estimation for a test ...
05/05/2022

Embedded Multilevel Regression and Poststratification: Model-based Inference with Incomplete Auxiliary Information

Health disparity research often evaluates health outcomes across subgrou...
03/09/2022

Data Representativity for Machine Learning and AI Systems

Data representativity is crucial when drawing inference from data throug...
01/12/2019

Optimization of Survey Weights under a Large Number of Conflicting Constraints

In the analysis of survey data, sampling weights are needed for consiste...