Deep Message Passing on Sets

09/21/2019
by   Yifeng Shi, et al.
0

Modern methods for learning over graph input data have shown the fruitfulness of accounting for relationships among elements in a collection. However, most methods that learn over set input data use only rudimentary approaches to exploit intra-collection relationships. In this work we introduce Deep Message Passing on Sets (DMPS), a novel method that incorporates relational learning for sets. DMPS not only connects learning on graphs with learning on sets via deep kernel learning, but it also bridges message passing on sets and traditional diffusion dynamics commonly used in denoising models. Based on these connections, we develop two new blocks for relational learning on sets: the set-denoising block and the set-residual block. The former is motivated by the connection between message passing on general graphs and diffusion-based denoising models, whereas the latter is inspired by the well-known residual network. In addition to demonstrating the interpretability of our model by learning the true underlying relational structure experimentally, we also show the effectiveness of our approach on both synthetic and real-world datasets by achieving results that are competitive with or outperform the state-of-the-art.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/05/2022

TIDE: Time Derivative Diffusion for Deep Learning on Graphs

A prominent paradigm for graph neural networks is based on the message p...
research
09/22/2013

A new look at reweighted message passing

We propose a new family of message passing techniques for MAP estimation...
research
04/01/2022

Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applications

Graphs are a powerful tool for representing and analyzing unstructured, ...
research
09/29/2020

Message Passing Neural Processes

Neural Processes (NPs) are powerful and flexible models able to incorpor...
research
09/12/2017

Weighted Message Passing and Minimum Energy Flow for Heterogeneous Stochastic Block Models with Side Information

We study the misclassification error for community detection in general ...
research
06/17/2022

ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphs

Many real-world data can be modeled as 3D graphs, but learning represent...
research
04/06/2020

Detecting Communities in Heterogeneous Multi-Relational Networks:A Message Passing based Approach

Community is a common characteristic of networks including social networ...

Please sign up or login with your details

Forgot password? Click here to reset