Semi-supervised Logistic Learning Based on Exponential Tilt Mixture Models

06/19/2019
by   Xinwei Zhang, et al.
Rutgers University
0

Consider semi-supervised learning for classification, where both labeled and unlabeled data are available for training. The goal is to exploit both datasets to achieve higher prediction accuracy than just using labeled data alone. We develop a semi-supervised logistic learning method based on exponential tilt mixture models, by extending a statistical equivalence between logistic regression and exponential tilt modeling. We study maximum nonparametric likelihood estimation and derive novel objective functions which are shown to be Fisher consistent. We also propose regularized estimation and construct simple and highly interpretable EM algorithms. Finally, we present numerical results which demonstrate the advantage of the proposed methods compared with existing methods.

READ FULL TEXT
08/26/2011

Semi-supervised logistic discrimination via labeled data and unlabeled data from different sampling distributions

This article addresses the problem of classification method based on bot...
06/25/2021

Self-training Converts Weak Learners to Strong Learners in Mixture Models

We consider a binary classification problem when the data comes from a m...
08/28/2020

Semi-supervised Learning with the EM Algorithm: A Comparative Study between Unstructured and Structured Prediction

Semi-supervised learning aims to learn prediction models from both label...
07/23/2017

Prediction-Constrained Training for Semi-Supervised Mixture and Topic Models

Supervisory signals have the potential to make low-dimensional data repr...
02/22/2011

Semi-supervised logistic discrimination for functional data

Multi-class classification methods based on both labeled and unlabeled f...
05/28/2016

Muffled Semi-Supervised Learning

We explore a novel approach to semi-supervised learning. This approach i...

Please sign up or login with your details

Forgot password? Click here to reset