Non-Parametric Learning of Lifted Restricted Boltzmann Machines

01/09/2020
by   Navdeep Kaur, et al.
0

We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter learning) sequentially, we develop a gradient-boosted approach that performs both simultaneously. Our approach learns a set of weak relational regression trees, whose paths from root to leaf are conjunctive clauses and represent the structure, and whose leaf values represent the parameters. When the learned relational regression trees are transformed into a lifted RBM, its hidden nodes are precisely the conjunctive clauses derived from the relational regression trees. This leads to a more interpretable and explainable model. Our empirical evaluations clearly demonstrate this aspect, while displaying no loss in effectiveness of the learned models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

07/25/2021

Relational Boosted Regression Trees

Many tasks use data housed in relational databases to train boosted regr...
01/02/2020

Non-Parametric Learning of Gaifman Models

We consider the problem of structure learning for Gaifman models and lea...
07/01/2016

Combining Gradient Boosting Machines with Collective Inference to Predict Continuous Values

Gradient boosting of regression trees is a competitive procedure for lea...
06/28/2016

A Learning Algorithm for Relational Logistic Regression: Preliminary Results

Relational logistic regression (RLR) is a representation of conditional ...
06/24/2017

Temporal-related Convolutional-Restricted-Boltzmann-Machine capable of learning relational order via reinforcement learning procedure?

In this article, we extend the conventional framework of convolutional-R...
04/24/2016

Rotation-Invariant Restricted Boltzmann Machine Using Shared Gradient Filters

Finding suitable features has been an essential problem in computer visi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.