Hierarchical Adaptive Pooling by Capturing High-order Dependency for Graph Representation Learning

04/13/2021
by   Ning Liu, et al.
6

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation is critical yet still challenging. Existing pooling methods either struggle to capture the local substructure or fail to effectively utilize high-order dependency, thus diminishing the expression capability. In this paper we propose HAP, a hierarchical graph-level representation learning framework, which is adaptively sensitive to graph structures, i.e., HAP clusters local substructures incorporating with high-order dependencies. HAP utilizes a novel cross-level attention mechanism MOA to naturally focus more on close neighborhood while effectively capture higher-order dependency that may contain crucial information. It also learns a global graph content GCont that extracts the graph pattern properties to make the pre- and post-coarsening graph content maintain stable, thus providing global guidance in graph coarsening. This novel innovation also facilitates generalization across graphs with the same form of features. Extensive experiments on fourteen datasets show that HAP significantly outperforms twelve popular graph pooling methods on graph classification task with an maximum accuracy improvement of 22.79 exceeds the performance of state-of-the-art graph matching and graph similarity learning algorithms by over 3.5

READ FULL TEXT

page 11

page 14

research
12/10/2020

CommPOOL: An Interpretable Graph Pooling Framework for Hierarchical Graph Representation Learning

Recent years have witnessed the emergence and flourishing of hierarchica...
research
05/17/2022

KGNN: Distributed Framework for Graph Neural Knowledge Representation

Knowledge representation learning has been commonly adopted to incorpora...
research
11/18/2019

ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations

Graph Neural Networks (GNN) have been shown to work effectively for mode...
research
05/24/2022

High-Order Pooling for Graph Neural Networks with Tensor Decomposition

Graph Neural Networks (GNNs) are attracting growing attention due to the...
research
06/19/2020

Graph Pooling with Node Proximity for Hierarchical Representation Learning

Graph neural networks have attracted wide attentions to enable represent...
research
08/06/2019

Sparse hierarchical representation learning on molecular graphs

Architectures for sparse hierarchical representation learning have recen...
research
12/28/2020

LookHops: light multi-order convolution and pooling for graph classification

Convolution and pooling are the key operations to learn hierarchical rep...

Please sign up or login with your details

Forgot password? Click here to reset