Dynamically Pruned Message Passing Networks for Large-Scale Knowledge Graph Reasoning

09/25/2019
by   Xiaoran Xu, et al.
0

We propose Dynamically Pruned Message Passing Networks (DPMPN) for large-scale knowledge graph reasoning. In contrast to existing models, embedding-based or path-based, we learn an input-dependent subgraph to explicitly model a sequential reasoning process. Each subgraph is dynamically constructed, expanding itself selectively under a flow-style attention mechanism. In this way, we can not only construct graphical explanations to interpret prediction, but also prune message passing in Graph Neural Networks (GNNs) to scale with the size of graphs. We take the inspiration from the consciousness prior proposed by Bengio to design a two-GNN framework to encode global input-invariant graph-structured representation and learn local input-dependent one coordinated by an attention module. Experiments show the reasoning capability in our model that is providing a clear graphical explanation as well as predicting results accurately, outperforming most state-of-the-art methods in knowledge base completion tasks.

READ FULL TEXT
05/30/2019

Neural Consciousness Flow

The ability of reasoning beyond data fitting is substantial to deep lear...
11/01/2018

Modeling Attention Flow on Graphs

Real-world scenarios demand reasoning about process, more than final out...
04/01/2018

Attentional Multilabel Learning over Graphs - A message passing approach

We address a largely open problem of multilabel classification over grap...
12/16/2021

Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching

Graph neural networks (GNNs) and message passing neural networks (MPNNs)...
06/30/2021

Informed Machine Learning for Improved Similarity Assessment in Process-Oriented Case-Based Reasoning

Currently, Deep Learning (DL) components within a Case-Based Reasoning (...
03/01/2021

Persistent Message Passing

Graph neural networks (GNNs) are a powerful inductive bias for modelling...
10/07/2020

TeMP: Temporal Message Passing for Temporal Knowledge Graph Completion

Inferring missing facts in temporal knowledge graphs (TKGs) is a fundame...