Inference from Non-Random Samples Using Bayesian Machine Learning

04/12/2021
by   Yutao Liu, et al.
0

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized prediction approach that predicts the outcomes in the population using a large number of auxiliary variables such that the ignorability assumption is reasonable while the Bayesian framework is straightforward for quantification of uncertainty. Besides the auxiliary variables, inspired by Little An (2004), we also extend the approach by estimating the propensity score for a unit to be included in the sample and also including it as a predictor in the machine learning models. We show through simulation studies that the regularized predictions using soft Bayesian additive regression trees yield valid inference for the population means and coverage rates close to the nominal levels. We demonstrate the application of the proposed methods using two different real data applications, one in a survey and one in an epidemiology study.

READ FULL TEXT

page 14

page 20

research
06/11/2019

An approximate Bayesian approach to regression estimation with many auxiliary variables

Model-assisted estimation with complex survey data is an important pract...
research
05/16/2018

Doubly Robust Inference with Non-probability Survey Samples

We establish a general framework for statistical inferences with non-pro...
research
01/15/2020

Generalized Bayesian Quantification Learning

Quantification Learning is the task of prevalence estimation for a test ...
research
05/05/2022

Embedded Multilevel Regression and Poststratification: Model-based Inference with Incomplete Auxiliary Information

Health disparity research often evaluates health outcomes across subgrou...
research
03/16/2020

Model-based Inference for Rare and Clustered Populations from Adaptive Cluster Sampling using Auxiliary Variables

Rare populations, such as endangered animals and plants, drug users and ...
research
03/09/2022

Data Representativity for Machine Learning and AI Systems

Data representativity is crucial when drawing inference from data throug...
research
07/13/2019

Leveraging Auxiliary Information on Marginal Distributions in Nonignorable Models for Item and Unit Nonresponse

When handling nonresponse, government agencies and survey organizations ...

Please sign up or login with your details

Forgot password? Click here to reset