Constrained Generation of Semantically Valid Graphs via Regularizing Variational Autoencoders

09/07/2018
by   Tengfei Ma, et al.
0

Deep generative models have achieved remarkable success in various data domains, including images, time series, and natural languages. There remain, however, substantial challenges for combinatorial structures, including graphs. One of the key challenges lies in the difficulty of ensuring semantic validity in context. For examples, in molecular graphs, the number of bonding-electron pairs must not exceed the valence of an atom; whereas in protein interaction networks, two proteins may be connected only when they belong to the same or correlated gene ontology terms. These constraints are not easy to be incorporated into a generative model. In this work, we propose a regularization framework for variational autoencoders as a step toward semantic validity. We focus on the matrix representation of graphs and formulate penalty terms that regularize the output distribution of the decoder to encourage the satisfaction of validity constraints. Experimental results confirm a much higher likelihood of sampling valid graphs in our approach, compared with others reported in the literature.

READ FULL TEXT
research
12/05/2017

Learning a Generative Model for Validity in Complex Discrete Structures

Deep generative models have been successfully used to learn representati...
research
05/31/2019

SELFIES: a robust representation of semantically constrained graphs with an example application in chemistry

Graphs are ideal representations of complex, relational information. The...
research
02/09/2018

GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders

Deep learning on graphs has become a popular research topic with many ap...
research
07/18/2019

Discrete Object Generation with Reversible Inductive Construction

The success of generative modeling in continuous domains has led to a su...
research
02/24/2018

Syntax-Directed Variational Autoencoder for Structured Data

Deep generative models have been enjoying success in modeling continuous...
research
05/26/2023

SR-OOD: Out-of-Distribution Detection via Sample Repairing

It is widely reported that deep generative models can classify out-of-di...
research
09/24/2019

Deep Generative Model for Sparse Graphs using Text-Based Learning with Augmentation in Generative Examination Networks

Graphs and networks are a key research tool for a variety of science fie...

Please sign up or login with your details

Forgot password? Click here to reset