Measurement error models: from nonparametric methods to deep neural networks

by   Zhirui Hu, et al.

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose an efficient neural network design for estimating measurement error models, in which we use a fully connected feed-forward neural network (FNN) to approximate the regression function f(x), a normalizing flow to approximate the prior distribution of X, and an inference network to approximate the posterior distribution of X. Our method utilizes recent advances in variational inference for deep neural networks, such as the importance weight autoencoder, doubly reparametrized gradient estimator, and non-linear independent components estimation. We conduct an extensive numerical study to compare the neural network approach with classical nonparametric methods and observe that the neural network approach is more flexible in accommodating different classes of regression functions and performs superior or comparable to the best available method in nearly all settings.



There are no comments yet.


page 28


Generalization Error Bounds for Deep Variational Inference

Variational inference is becoming more and more popular for approximatin...

Probabilistic Models with Deep Neural Networks

Recent advances in statistical inference have significantly expanded the...

Convergence Rates of Variational Inference in Sparse Deep Learning

Variational inference is becoming more and more popular for approximatin...

Visual Recognition with Deep Learning from Biased Image Datasets

In practice, and more especially when training deep neural networks, vis...

Estimation of a regression function on a manifold by fully connected deep neural networks

Estimation of a regression function from independent and identically dis...

Neural Networks for Partially Linear Quantile Regression

Deep learning has enjoyed tremendous success in a variety of application...

DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework

Recent advances in deep learning motivate the use of deep neutral networ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.