G2GT: Retrosynthesis Prediction with Graph to Graph Attention Neural Network and Self-Training

04/19/2022
by   Zaiyun Lin, et al.
0

Retrosynthesis prediction is one of the fundamental challenges in organic chemistry and related fields. The goal is to find reactants molecules that can synthesize product molecules. To solve this task, we propose a new graph-to-graph transformation model, G2GT, in which the graph encoder and graph decoder are built upon the standard transformer structure. We also show that self-training, a powerful data augmentation method that utilizes unlabeled molecule data, can significantly improve the model's performance. Inspired by the reaction type label and ensemble learning, we proposed a novel weak ensemble method to enhance diversity. We combined beam search, nucleus, and top-k sampling methods to further improve inference diversity and proposed a simple ranking algorithm to retrieve the final top-10 results. We achieved new state-of-the-art results on both the USPTO-50K dataset, with top1 accuracy of 54 competitive top-10 results.

READ FULL TEXT

page 4

page 12

research
12/22/2018

Graph Transformation Policy Network for Chemical Reaction Prediction

We address a fundamental problem in chemistry known as chemical reaction...
research
06/12/2020

Learning Graph Models for Template-Free Retrosynthesis

Retrosynthesis prediction is a fundamental problem in organic synthesis,...
research
06/12/2023

Rotational augmentation techniques: a new perspective on ensemble learning for image classification

The popularity of data augmentation techniques in machine learning has i...
research
04/17/2020

Continuous Representation of Molecules Using Graph Variational Autoencoder

In order to continuously represent molecules, we propose a generative mo...
research
08/28/2023

Diversified Ensemble of Independent Sub-Networks for Robust Self-Supervised Representation Learning

Ensembling a neural network is a widely recognized approach to enhance m...
research
03/05/2020

Augmented Transformer Achieves 97 and Classical Retro-Synthesis

We investigated the effect of different augmentation scenarios on predic...
research
10/17/2019

Predicting retrosynthetic pathways using a combined linguistic model and hyper-graph exploration strategy

We present an extension of our Molecular Transformer architecture combin...

Please sign up or login with your details

Forgot password? Click here to reset