Graph Entropy Guided Node Embedding Dimension Selection for Graph Neural Networks

05/07/2021
by   Gongxu Luo, et al.
12

Graph representation learning has achieved great success in many areas, including e-commerce, chemistry, biology, etc. However, the fundamental problem of choosing the appropriate dimension of node embedding for a given graph still remains unsolved. The commonly used strategies for Node Embedding Dimension Selection (NEDS) based on grid search or empirical knowledge suffer from heavy computation and poor model performance. In this paper, we revisit NEDS from the perspective of minimum entropy principle. Subsequently, we propose a novel Minimum Graph Entropy (MinGE) algorithm for NEDS with graph data. To be specific, MinGE considers both feature entropy and structure entropy on graphs, which are carefully designed according to the characteristics of the rich information in them. The feature entropy, which assumes the embeddings of adjacent nodes to be more similar, connects node features and link topology on graphs. The structure entropy takes the normalized degree as basic unit to further measure the higher-order structure of graphs. Based on them, we design MinGE to directly calculate the ideal node embedding dimension for any graph. Finally, comprehensive experiments with popular Graph Neural Networks (GNNs) on benchmark datasets demonstrate the effectiveness and generalizability of our proposed MinGE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2019

Graph Neural Networks with High-order Feature Interactions

Network representation learning, a fundamental research problem which ai...
research
01/07/2021

SDGNN: Learning Node Representation for Signed Directed Networks

Network embedding is aimed at mapping nodes in a network into low-dimens...
research
08/31/2021

Position-based Hash Embeddings For Scaling Graph Neural Networks

Graph Neural Networks (GNNs) bring the power of deep representation lear...
research
06/11/2021

Is Homophily a Necessity for Graph Neural Networks?

Graph neural networks (GNNs) have shown great prowess in learning repres...
research
10/07/2019

Graph Few-shot Learning via Knowledge Transfer

Towards the challenging problem of semi-supervised node classification, ...
research
01/15/2018

On the Distribution of Random Geometric Graphs

Random geometric graphs (RGGs) are commonly used to model networked syst...
research
06/08/2023

Hybrid Graph: A Unified Graph Representation with Datasets and Benchmarks for Complex Graphs

Graphs are widely used to encapsulate a variety of data formats, but rea...

Please sign up or login with your details

Forgot password? Click here to reset