Accuracy of Latent-Variable Estimation in Bayesian Semi-Supervised Learning

08/09/2013
by   Keisuke Yamazaki, et al.
0

Hierarchical probabilistic models, such as Gaussian mixture models, are widely used for unsupervised learning tasks. These models consist of observable and latent variables, which represent the observable data and the underlying data-generation process, respectively. Unsupervised learning tasks, such as cluster analysis, are regarded as estimations of latent variables based on the observable ones. The estimation of latent variables in semi-supervised learning, where some labels are observed, will be more precise than that in unsupervised, and one of the concerns is to clarify the effect of the labeled data. However, there has not been sufficient theoretical analysis of the accuracy of the estimation of latent variables. In a previous study, a distribution-based error function was formulated, and its asymptotic form was calculated for unsupervised learning with generative models. It has been shown that, for the estimation of latent variables, the Bayes method is more accurate than the maximum-likelihood method. The present paper reveals the asymptotic forms of the error function in Bayesian semi-supervised learning for both discriminative and generative models. The results show that the generative model, which uses all of the given data, performs better when the model is well specified.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2015

Bayesian Estimation of Multidimensional Latent Variables and Its Asymptotic Accuracy

Hierarchical learning models, such as mixture models and Bayesian networ...
research
04/10/2012

Asymptotic Accuracy of Distribution-Based Estimation for Latent Variables

Hierarchical statistical models are widely employed in information scien...
research
07/13/2016

Effects of Additional Data on Bayesian Clustering

Hierarchical probabilistic models, such as mixture models, are used for ...
research
11/01/2018

Neural Rendering Model: Joint Generation and Prediction for Semi-Supervised Learning

Unsupervised and semi-supervised learning are important problems that ar...
research
06/23/2022

Few-Shot Non-Parametric Learning with Deep Latent Variable Model

Most real-world problems that machine learning algorithms are expected t...
research
09/15/2022

Fair Inference for Discrete Latent Variable Models

It is now well understood that machine learning models, trained on data ...
research
06/28/2019

Benefits of Overparameterization in Single-Layer Latent Variable Generative Models

One of the most surprising and exciting discoveries in supervising learn...

Please sign up or login with your details

Forgot password? Click here to reset