Evaluating Graph Generative Models with Contrastively Learned Features

06/13/2022
by   Hamed Shirzad, et al.
0

A wide range of models have been proposed for Graph Generative Models, necessitating effective methods to evaluate their quality. So far, most techniques use either traditional metrics based on subgraph counting, or the representations of randomly initialized Graph Neural Networks (GNNs). We propose using representations from contrastively trained GNNs, rather than random GNNs, and show this gives more reliable evaluation metrics. Neither traditional approaches nor GNN-based approaches dominate the other, however: we give examples of graphs that each approach is unable to distinguish. We demonstrate that Graph Substructure Networks (GSNs), which in a way combine both approaches, are better at distinguishing the distances between graph datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2022

On Evaluation Metrics for Graph Generative Models

In image generation, generative models can be evaluated naturally by vis...
research
04/15/2022

A generative neural network model for random dot product graphs

We present GraphMoE, a novel neural network-based approach to learning g...
research
08/23/2023

Will More Expressive Graph Neural Networks do Better on Generative Tasks?

Graph generation poses a significant challenge as it involves predicting...
research
08/19/2022

Demystifying Randomly Initialized Networks for Evaluating Generative Models

Evaluation of generative models is mostly based on the comparison betwee...
research
07/13/2023

GRAN is superior to GraphRNN: node orderings, kernel- and graph embeddings-based metrics for graph generators

A wide variety of generative models for graphs have been proposed. They ...
research
06/02/2021

Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions

Graph generative models are a highly active branch of machine learning. ...
research
02/14/2022

Delaunay Component Analysis for Evaluation of Data Representations

Advanced representation learning techniques require reliable and general...

Please sign up or login with your details

Forgot password? Click here to reset