Augmented Transformer Achieves 97 and Classical Retro-Synthesis

03/05/2020

∙

We investigated the effect of different augmentation scenarios on predicting (retro)synthesis of chemical compounds using SMILES representation. We showed that augmentation of not only input sequences but also, importantly, of the target data eliminated the effect of data memorization by neural networks and improved their generalization performance for prediction of new sequences. The Top-5 accuracy was 85.4 identifying principal transformation for classical retro-synthesis) for USPTO-50k test dataset and was achieved by a combination of SMILES augmentation and beam search. The same approach also outperformed best published results for prediction of direct reactions from the USPTO-MIT test set. Our model achieved 90.4 Top-5 accuracy for the USPTO-MIT separated set. The appearance frequency of the most abundantly generated SMILES was well correlated with the prediction outcome and can be used as a measure of the quality of reaction prediction.

READ FULL TEXT

Augmented Transformer Achieves 97 and Classical Retro-Synthesis

Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction prediction

The prediction of the quality of results in Logic Synthesis using Transformer and Graph Neural Networks

Molecular Transformer for Chemical Reaction Prediction and Uncertainty Estimation

Predicting Retrosynthetic Reaction using Self-Corrected Transformer Neural Networks

Data Augmentation for Human Behavior Analysis in Multi-Person Conversations

G2GT: Retrosynthesis Prediction with Graph to Graph Attention Neural Network and Self-Training

First Order Ambisonics Domain Spatial Augmentation for DNN-based Direction of Arrival Estimation

Augmented Transformer Achieves 97 and Classical Retro-Synthesis

Related Research

Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction prediction

The prediction of the quality of results in Logic Synthesis using Transformer and Graph Neural Networks

Molecular Transformer for Chemical Reaction Prediction and Uncertainty Estimation

Predicting Retrosynthetic Reaction using Self-Corrected Transformer Neural Networks

Data Augmentation for Human Behavior Analysis in Multi-Person Conversations

G2GT: Retrosynthesis Prediction with Graph to Graph Attention Neural Network and Self-Training

First Order Ambisonics Domain Spatial Augmentation for DNN-based Direction of Arrival Estimation