RLSynC: Offline-Online Reinforcement Learning for Synthon Completion

by   Frazier N. Baker, et al.

Retrosynthesis is the process of determining the set of reactant molecules that can react to form a desired product. Semi-template-based retrosynthesis methods, which imitate the reverse logic of synthesis reactions, first predict the reaction centers in the products, and then complete the resulting synthons back into reactants. These methods enable necessary interpretability and high practical utility to inform synthesis planning. We develop a new offline-online reinforcement learning method RLSynC for synthon completion in semi-template-based methods. RLSynC assigns one agent to each synthon, all of which complete the synthons by conducting actions step by step in a synchronized fashion. RLSynC learns the policy from both offline training episodes and online interactions which allow RLSynC to explore new reaction spaces. RLSynC uses a forward synthesis model to evaluate the likelihood of the predicted reactants in synthesizing a product, and thus guides the action search. We compare RLSynC with the state-of-the-art retrosynthesis methods. Our experimental results demonstrate that RLSynC can outperform these methods with improvement as high as 14.9 retrosynthesis, highlighting its potential in synthesis planning.

βˆ™ 06/10/2022

𝖦^2π–±π–Ύπ—π—‹π—ˆ: Two-Step Graph Generative Models for Retrosynthesis Prediction

Retrosynthesis is a procedure where a molecule is transformed into poten...
βˆ™ 04/13/2021

Online and Offline Reinforcement Learning by Planning with a Learned Model

Learning efficiently from small amounts of data has long been the focus ...
βˆ™ 04/07/2021

Modern Hopfield Networks for Few- and Zero-Shot Reaction Prediction

An essential step in the discovery of new drugs and materials is the syn...
βˆ™ 01/12/2021

Automated Synthesis of Steady-State Continuous Processes using Reinforcement Learning

Automated flowsheet synthesis is an important field in computer-aided pr...
βˆ™ 05/22/2023

INVICTUS: Optimizing Boolean Logic Circuit Synthesis via Synergistic Learning and Search

Logic synthesis is the first and most vital step in chip design. This st...
βˆ™ 01/31/2023

Retrosynthetic Planning with Dual Value Networks

Retrosynthesis, which aims to find a route to synthesize a target molecu...
βˆ™ 08/10/2023

Models Matter: The Impact of Single-Step Retrosynthesis on Synthesis Planning

Retrosynthesis consists of breaking down a chemical compound recursively...

Please sign up or login with your details

Forgot password? Click here to reset