DeepAI AI Chat
Log In Sign Up

Semi-supervised Inference: General Theory and Estimation of Means

by   Anru Zhang, et al.

We propose a general semi-supervised inference framework focused on the estimation of the population mean. We consider both the ideal semi-supervised setting where infinitely many unlabeled samples are available, as well as the ordinary semi-supervised setting in which only a finite number of unlabeled samples is available. As usual in semi-supervised settings, there exists an unlabeled sample of covariate vectors and a labeled sample consisting of covariate vectors along with real-valued responses ("labels"). Otherwise the formulation is "assumption-lean" in that no major conditions are imposed on the statistical or functional form of the data. Estimators are proposed along with corresponding confidence intervals for the population mean. Theoretical analysis on both the asymptotic behavior and ℓ_2-risk for the proposed procedures are given. Surprisingly, the proposed estimators, based on a simple form of the least squares method, outperform the ordinary sample mean. The method is further extended to a nonparametric setting, in which the oracle rate can be achieved asymptotically. The proposed estimators are further illustrated by simulation studies and a real data example involving estimation of the homeless population.


page 1

page 2

page 3

page 4


High-dimensional semi-supervised learning: in search for optimal inference of the mean

We provide a high-dimensional semi-supervised inference framework focuse...

Adaptive Semi-Supervised Inference for Optimal Treatment Decisions with Electronic Medical Record Data

A treatment regime is a rule that assigns a treatment to patients based ...

Minimax semi-supervised confidence sets for multi-class classification

In this work we study the semi-supervised framework of confidence set cl...

Semi-Supervised Approaches to Efficient Evaluation of Model Prediction Performance

In many modern machine learning applications, the outcome is expensive o...

Semi-supervised Transfer Learning for Evaluation of Model Classification Performance

In modern machine learning applications, frequent encounters of covariat...

The Peaking Phenomenon in Semi-supervised Learning

For the supervised least squares classifier, when the number of training...

On asymptotic normality in estimation after a group sequential trial

We prove that in many realistic cases, the ordinary sample mean after a ...