Machine Learning on Graphs: A Model and Comprehensive Taxonomy

05/07/2020
by   Ines Chami, et al.
44

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first, network embedding (such as shallow graph embedding or graph auto-encoders), focuses on learning unsupervised representations of relational structure. The second, graph regularized neural networks, leverages graphs to augment neural network losses with a regularization objective for semi-supervised learning. The third, graph neural networks, aims to learn differentiable functions over discrete topologies with arbitrary structure. However, despite the popularity of these areas there has been surprisingly little work on unifying the three paradigms. Here, we aim to bridge the gap between graph neural networks, network embedding and graph regularization models. We propose a comprehensive taxonomy of representation learning methods for graph-structured data, aiming to unify several disparate bodies of work. Specifically, we propose a Graph Encoder Decoder Model (GRAPHEDM), which generalizes popular algorithms for semi-supervised learning on graphs (e.g. GraphSage, Graph Convolutional Networks, Graph Attention Networks), and unsupervised learning of graph representations (e.g. DeepWalk, node2vec, etc) into a single consistent approach. To illustrate the generality of this approach, we fit over thirty existing methods into this framework. We believe that this unifying view both provides a solid foundation for understanding the intuition behind these methods, and enables future research in the area.

READ FULL TEXT
research
09/25/2019

GraphMix: Regularized Training of Graph Neural Networks for Semi-Supervised Learning

We present GraphMix, a regularization technique for Graph Neural Network...
research
03/24/2021

Graph Representation Learning by Ensemble Aggregating Subgraphs via Mutual Information Maximization

Graph Neural Networks have shown tremendous potential on dealing with ga...
research
05/15/2019

GMNN: Graph Markov Neural Networks

This paper studies semi-supervised object classification in relational d...
research
01/02/2022

Semi-Supervised Graph Attention Networks for Event Representation Learning

Event analysis from news and social networks is very useful for a wide r...
research
02/26/2021

Graph-based Semi-supervised Learning: A Comprehensive Review

Semi-supervised learning (SSL) has tremendous value in practice due to i...
research
06/06/2021

Graph2Graph Learning with Conditional Autoregressive Models

We present a graph neural network model for solving graph-to-graph learn...
research
01/19/2021

A Unifying Generative Model for Graph Learning Algorithms: Label Propagation, Graph Convolutions, and Combinations

Semi-supervised learning on graphs is a widely applicable problem in net...

Please sign up or login with your details

Forgot password? Click here to reset