DeepAI AI Chat
Log In Sign Up

Graph Belief Propagation Networks

by   Junteng Jia, et al.

With the wide-spread availability of complex relational data, semi-supervised node classification in graphs has become a central machine learning problem. Graph neural networks are a recent class of easy-to-train and accurate methods for this problem that map the features in the neighborhood of a node to its label, but they ignore label correlation during inference and their predictions are difficult to interpret. On the other hand, collective classification is a traditional approach based on interpretable graphical models that explicitly model label correlations. Here, we introduce a model that combines the advantages of these two approaches, where we compute the marginal probabilities in a conditional random field, similar to collective classification, and the potentials in the random field are learned through end-to-end training, akin to graph neural networks. In our model, potentials on each node only depend on that node's features, and edge potentials are learned via a coupling matrix. This structure enables simple training with interpretable parameters, scales to large networks, naturally incorporates training labels at inference, and is often more accurate than related approaches. Our approach can be viewed as either an interpretable message-passing graph neural network or a collective classification method with higher capacity and modernized training.


GMNN: Graph Markov Neural Networks

This paper studies semi-supervised object classification in relational d...

A Unifying Generative Model for Graph Learning Algorithms: Label Propagation, Graph Convolutions, and Combinations

Semi-supervised learning on graphs is a widely applicable problem in net...

End-to-end learning potentials for structured attribute prediction

We present a structured inference approach in deep neural networks for m...

Set Twister for Single-hop Node Classification

Node classification is a central task in relational learning, with the c...

Accurate Node Feature Estimation with Structured Variational Graph Autoencoder

Given a graph with partial observations of node features, how can we est...

Outcome Correlation in Graph Neural Network Regression

Graph neural networks aggregate features in vertex neighborhoods to lear...

Generalized Collective Inference with Symmetric Clique Potentials

Collective graphical models exploit inter-instance associative dependenc...