Measurement error models: from nonparametric methods to deep neural networks

07/15/2020
by   Zhirui Hu, et al.
0

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose an efficient neural network design for estimating measurement error models, in which we use a fully connected feed-forward neural network (FNN) to approximate the regression function f(x), a normalizing flow to approximate the prior distribution of X, and an inference network to approximate the posterior distribution of X. Our method utilizes recent advances in variational inference for deep neural networks, such as the importance weight autoencoder, doubly reparametrized gradient estimator, and non-linear independent components estimation. We conduct an extensive numerical study to compare the neural network approach with classical nonparametric methods and observe that the neural network approach is more flexible in accommodating different classes of regression functions and performs superior or comparable to the best available method in nearly all settings.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 28

08/09/2019

Generalization Error Bounds for Deep Variational Inference

Variational inference is becoming more and more popular for approximatin...
08/09/2019

Probabilistic Models with Deep Neural Networks

Recent advances in statistical inference have significantly expanded the...
08/09/2019

Convergence Rates of Variational Inference in Sparse Deep Learning

Variational inference is becoming more and more popular for approximatin...
09/06/2021

Visual Recognition with Deep Learning from Biased Image Datasets

In practice, and more especially when training deep neural networks, vis...
07/20/2021

Estimation of a regression function on a manifold by fully connected deep neural networks

Estimation of a regression function from independent and identically dis...
06/11/2021

Neural Networks for Partially Linear Quantile Regression

Deep learning has enjoyed tremendous success in a variety of application...
06/05/2017

DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework

Recent advances in deep learning motivate the use of deep neutral networ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.