DeepAI
Log In Sign Up

Graph Neural Networks with Composite Kernels

05/16/2020
by   Yufan Zhou, et al.
0

Learning on graph structured data has drawn increasing interest in recent years. Frameworks like Graph Convolutional Networks (GCNs) have demonstrated their ability to capture structural information and obtain good performance in various tasks. In these frameworks, node aggregation schemes are typically used to capture structural information: a node's feature vector is recursively computed by aggregating features of its neighboring nodes. However, most of aggregation schemes treat all connections in a graph equally, ignoring node feature similarities. In this paper, we re-interpret node aggregation from the perspective of kernel weighting, and present a framework to consider feature similarity in an aggregation scheme. Specifically, we show that normalized adjacency matrix is equivalent to a neighbor-based kernel matrix in a Krein Space. We then propose feature aggregation as the composition of the original neighbor-based kernel and a learnable kernel to encode feature similarities in a feature space. We further show how the proposed method can be extended to Graph Attention Network (GAT). Experimental results demonstrate better performance of our proposed framework in several real-world applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/19/2020

Node Similarity Preserving Graph Convolutional Networks

Graph Neural Networks (GNNs) have achieved tremendous success in various...
01/06/2021

Node2Seq: Towards Trainable Convolutions in Graph Neural Networks

Investigating graph feature learning becomes essentially important with ...
02/13/2020

Geom-GCN: Geometric Graph Convolutional Networks

Message-passing neural networks (MPNNs) have been successfully applied t...
10/29/2021

GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily

Graph Neural Networks (GNNs) are widely used on a variety of graph-based...
03/02/2020

Permutohedral-GCN: Graph Convolutional Networks with Global Attention

Graph convolutional networks (GCNs) update a node's feature vector by ag...
05/21/2022

Micro-video recommendation model based on graph neural network and attention mechanism

With the rapid development of Internet technology and the comprehensive ...
04/09/2019

Just Jump: Dynamic Neighborhood Aggregation in Graph Neural Networks

We propose a dynamic neighborhood aggregation (DNA) procedure guided by ...