Matrix Variate RBM and Its Applications

01/05/2016
by   Guanglei Qi, et al.
0

Restricted Boltzmann Machine (RBM) is an importan- t generative model modeling vectorial data. While applying an RBM in practice to images, the data have to be vec- torized. This results in high-dimensional data and valu- able spatial information has got lost in vectorization. In this paper, a Matrix-Variate Restricted Boltzmann Machine (MVRBM) model is proposed by generalizing the classic RBM to explicitly model matrix data. In the new RBM model, both input and hidden variables are in matrix forms which are connected by bilinear transforms. The MVRBM has much less model parameters, resulting in a faster train- ing algorithm while retaining comparable performance as the classic RBM. The advantages of the MVRBM have been demonstrated on two real-world applications: Image super- resolution and handwritten digit recognition.

READ FULL TEXT

page 6

page 7

page 8

research
09/21/2016

Matrix Variate RBM Model with Gaussian Distributions

Restricted Boltzmann Machine (RBM) is a particular type of random neural...
research
08/17/2015

A Generative Model for Multi-Dialect Representation

In the era of deep learning several unsupervised models have been develo...
research
10/21/2017

A Generative Restricted Boltzmann Machine Based Method for High-Dimensional Motion Data Modeling

Many computer vision applications involve modeling complex spatio-tempor...
research
04/28/2018

Learning from multivariate discrete sequential data using a restricted Boltzmann machine model

A restricted Boltzmann machine (RBM) is a generative neural-network mode...
research
11/27/2020

Tractable loss function and color image generation of multinary restricted Boltzmann machine

The restricted Boltzmann machine (RBM) is a representative generative mo...
research
11/12/2018

Matrix Product Operator Restricted Boltzmann Machines

A restricted Boltzmann machine (RBM) learns a probability distribution o...
research
10/21/2020

Highly-scalable stochastic neuron based on Ovonic Threshold Switch (OTS) and its applications in Restricted Boltzmann Machine (RBM)

Interest in Restricted Boltzmann Machine (RBM) is growing as a generativ...

Please sign up or login with your details

Forgot password? Click here to reset