Towards a Taxonomy of Graph Learning Datasets

10/27/2021
by   Renming Liu, et al.
37

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures to demonstrate the superiority of one GNN model over the others, there is a lack of systematic understanding of the underlying benchmarking datasets, and what aspects of the model are being tested. Here, we provide a principled approach to taxonomize graph benchmarking datasets by carefully designing a collection of graph perturbations to probe the essential data characteristics that GNN models leverage to perform predictions. Our data-driven taxonomization of graph datasets provides a new understanding of critical dataset characteristics that will enable better model evaluation and the development of more specialized GNN models.

READ FULL TEXT

page 3

page 4

research
06/15/2022

Taxonomy of Benchmarks in Graph Representation Learning

Graph Neural Networks (GNNs) extend the success of neural networks to gr...
research
10/25/2022

Benchmarking Graph Neural Networks for Internet Routing Data

The Internet is composed of networks, called Autonomous Systems (or, ASe...
research
07/17/2023

Examining the Effects of Degree Distribution and Homophily in Graph Learning Models

Despite a surge in interest in GNN development, homogeneity in benchmark...
research
02/28/2022

GraphWorld: Fake Graphs Bring Real Insights for GNNs

Despite advances in the field of Graph Neural Networks (GNNs), only a sm...
research
07/08/2023

Fairness-Aware Graph Neural Networks: A Survey

Graph Neural Networks (GNNs) have become increasingly important due to t...
research
05/03/2023

Rethinking Graph Lottery Tickets: Graph Sparsity Matters

Lottery Ticket Hypothesis (LTH) claims the existence of a winning ticket...
research
03/02/2020

Benchmarking Graph Neural Networks

Graph neural networks (GNNs) have become the standard toolkit for analyz...

Please sign up or login with your details

Forgot password? Click here to reset