Structural Optimization Makes Graph Classification Simpler and Better

09/05/2021
by   Junran Wu, et al.
0

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models. Here, based on an optimization method, we investigate the feasibility of improving graph classification performance while simplifying the model learning process. Inspired by progress in structural information assessment, we optimize the given data sample from graphs to encoding trees. In particular, we minimize the structural entropy of the transformed encoding tree to decode the key structure underlying a graph. This transformation is denoted as structural optimization. Furthermore, we propose a novel feature combination scheme, termed hierarchical reporting, for encoding trees. In this scheme, features are transferred from leaf nodes to root nodes by following the hierarchical structures of encoding trees. We then present an implementation of the scheme in a tree kernel and a convolutional network to perform graph classification. The tree kernel follows label propagation in the Weisfeiler-Lehman (WL) subtree kernel, but it has a lower runtime complexity O(n). The convolutional network is a special implementation of our tree kernel in the deep learning field and is called Encoding Tree Learning (ETL). We empirically validate our tree kernel and convolutional network with several graph classification benchmarks and demonstrate that our methods achieve better performance and lower computational consumption than competing approaches.

READ FULL TEXT

page 13

page 14

research
06/06/2022

A Simple yet Effective Method for Graph Classification

In deep neural networks, better results can often be obtained by increas...
research
03/17/2023

SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization

Graph Neural Networks (GNNs) are de facto solutions to structural data l...
research
07/26/2022

Dynamic Measurement of Structural Entropy for Dynamic Graphs

Structural entropy solves the problem of measuring the amount of informa...
research
10/05/2021

TENT: Text Classification Based on ENcoding Tree Learning

Text classification is a primary task in natural language processing (NL...
research
01/27/2020

Structural Information Learning Machinery: Learning from Observing, Associating, Optimizing, Decoding, and Abstracting

In the present paper, we propose the model of structural information le...
research
04/06/2016

A Subpath Kernel for Learning Hierarchical Image Representations

Tree kernels have demonstrated their ability to deal with hierarchical d...
research
04/05/2015

Discriminative Neural Sentence Modeling by Tree-Based Convolution

This paper proposes a tree-based convolutional neural network (TBCNN) fo...

Please sign up or login with your details

Forgot password? Click here to reset