Semiparametric Wavelet-based JPEG IV Estimator for endogenously truncated data

08/06/2019
by   Nir Billfeld, et al.
0

A new and an enriched JPEG algorithm is provided for identifying redundancies in a sequence of irregular noisy data points which also accommodates a reference-free criterion function. Our main contribution is by formulating analytically (instead of approximating) the inverse of the transpose of JPEGwavelet transform without involving matrices which are computationally cumbersome. The algorithm is suitable for the widely-spread situations where the original data distribution is unobservable such as in cases where there is deficient representation of the entire population in the training data (in machine learning) and thus the covariate shift assumption is violated. The proposed estimator corrects for both biases, the one generated by endogenous truncation and the one generated by endogenous covariates. Results from utilizing 2,000,000 different distribution functions verify the applicability and high accuracy of our procedure to cases in which the disturbances are neither jointly nor marginally normally distributed.

READ FULL TEXT

page 4

page 5

page 7

page 8

page 10

page 11

page 12

page 17

research
02/17/2019

Semiparametric correction for endogenous truncation bias with Vox Populi based participation decision

We synthesize the knowledge present in various scientific disciplines fo...
research
05/19/2021

More Generalizable Models For Sepsis Detection Under Covariate Shift

Sepsis is a major cause of mortality in the intensive care units (ICUs)....
research
07/21/2023

General regularization in covariate shift adaptation

Sample reweighting is one of the most widely used methods for correcting...
research
02/08/2018

More Efficient Estimation for Logistic Regression with Optimal Subsample

Facing large amounts of data, subsampling is a practical technique to ex...
research
02/23/2018

Nonparametric Estimation of a distribution function from doubly truncated data under dependence

The NPMLE of a distribution function from doubly truncated data was intr...
research
05/07/2023

Classification Tree Pruning Under Covariate Shift

We consider the problem of pruning a classification tree, that is, selec...
research
06/20/2022

Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experiments

We develop a new, principled algorithm for estimating the contribution o...

Please sign up or login with your details

Forgot password? Click here to reset