Discriminative Probabilistic Models for Relational Data

12/12/2012
by   Ben Taskar, et al.
0

In many supervised learning tasks, the entities to be labeled are related to each other in complex ways and their labels are not independent. For example, in hypertext classification, the labels of linked pages are highly correlated. A standard approach is to classify each entity independently, ignoring the correlations between them. Recently, Probabilistic Relational Models, a relational version of Bayesian networks, were used to define a joint probabilistic model for a collection of related entities. In this paper, we present an alternative framework that builds on (conditional) Markov networks and addresses two limitations of the previous approach. First, undirected models do not impose the acyclicity constraint that hinders representation of many important relational dependencies in directed models. Second, undirected models are well suited for discriminative training, where we optimize the conditional likelihood of the labels given the features, which generally improves classification accuracy. We show how to train these models effectively, and how to use approximate probabilistic inference over the learned model for collective classification of multiple related entities. We provide experimental results on a webpage classification task, showing that accuracy can be significantly improved by modeling relational dependencies.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
09/11/2016

Relational Models

We provide a survey on relational models. Relational models describe com...
research
05/15/2019

GMNN: Graph Markov Neural Networks

This paper studies semi-supervised object classification in relational d...
research
03/02/2016

Probabilistic Relational Model Benchmark Generation

The validation of any database mining methodology goes through an evalua...
research
02/09/2017

Graph Based Relational Features for Collective Classification

Statistical Relational Learning (SRL) methods have shown that classifica...
research
09/15/2016

Column Networks for Collective Classification

Relational learning deals with data that are characterized by relational...
research
06/20/2012

Mixture-of-Parents Maximum Entropy Markov Models

We present the mixture-of-parents maximum entropy Markov model (MoP-MEMM...

Please sign up or login with your details

Forgot password? Click here to reset